Automation & Ops ✓ Microsoft · Official

Azure Pipelines Validation Assistant

Validate VS Code Azure DevOps pipeline changes without waiting for full CI feedback.

47/ 100
Use with care

Useful, but reliability, evidence or controls still have material gaps.

See how it was scored ↓
Works as-is in
Codex · Claude Code
Stars
★ 194k
Last updated
11d ago
License
MIT
azure-pipelinesazure-devopspipeline-validationbuild-monitoring
+2build-logsnodejs

What does this skill do, and when should you use it?

This skill is for developers changing VS Code Azure DevOps pipeline YAML. It uses the repository’s Node.js script to queue builds, inspect and watch their status, download logs and artifacts, and cancel obsolete runs. Its purpose is to shorten the feedback loop compared with pushing changes and waiting for full CI. It targets the Monaco project’s pipeline definition 111 rather than serving as a general Azure Pipelines configuration generator.

Checks for Azure CLI and the Azure DevOps extension, then guides authentication and default organization/project configuration. Runs .github/skills/azure-pipelines/azure-pipeline.ts to queue a build for the current or a named branch, pass repeatable KEY=value parameters, or perform a dry run. Retrieves recent or specified build status, filters by branch, reason, or definition, watches until completion, and downloads selected logs or artifacts to /tmp. Cancels a running build by build ID.

Good fit
  • A developer changes YAML under `build/azure-pipelines/` and wants to queue a validation build before committing.
  • A developer is iterating on pipeline changes and needs to cancel an obsolete build before starting a replacement.
  • A developer needs to monitor a running build every 30 seconds or at a custom interval.
  • A developer is investigating a build and needs its overview, a specific log, or a named artifact.
  • A developer wants a quicker validation by disabling Web, publishing, release flow, or selected platform builds.

How do you install this skill?

Before you use it
  • The queue workflow may enable publishing by default; verify VSCODE_PUBLISH, VSCODE_RELEASE, and all build parameters before execution.
  • The parameter table conflicts with examples, especially for VSCODE_BUILD_TYPE, so example values should not be assumed valid.
  • Status-query failures may appear as no builds or empty results; Azure CLI, authentication, and Azure DevOps network reachability are hard dependencies.
Before you start
Your agent needs
  • Shell / CLI
  • Network access
  • Local filesystem
Install first
  • Node.js
  • Azure CLI
  • Azure DevOps CLI extension
  • Git

The skill is bundled with the 61 skills in the microsoft/vscode repository at .github/skills/azure-pipelines/SKILL.md. The source does not document a standalone installer or package; use it from that repository with its azure-pipeline.ts file present. Before running it, have Node.js, Azure CLI, and the Azure DevOps CLI extension available, then follow the documented setup with az login and az devops configure --defaults organization=https://dev.azure.com/monacotools project=Monaco.

Generic route: install into Claude Code manually (macOS / Linux)
tmp="$(mktemp -d)"
git clone --depth 1 https://github.com/microsoft/vscode.git "$tmp"
mkdir -p ~/.claude/skills
cp -R "$tmp/.github/skills/azure-pipelines" ~/.claude/skills/
rm -rf "$tmp"

Generated from the source repository and skill path; it copies only this skill's folder. If the author's install steps above differ, follow those first. To scope it to one project, replace ~/.claude/skills with that project's .claude/skills.

How do you use this skill?

Try saying

Once installed, send your agent any of these to trigger it:

  • Test my Azure Pipelines YAML changes, queue a build, and poll it until completion

From the repository root, run node .github/skills/azure-pipelines/azure-pipeline.ts queue. Use queue --branch my-feature-branch for a specific branch, add parameters such as --parameter "VSCODE_PUBLISH=false", or use --dry-run to print the command only. Find a build with node .github/skills/azure-pipelines/azure-pipeline.ts status, watch it with status --build-id 123456 --watch, or cancel it with cancel --build-id 123456. A suitable agent request is “Test my Azure Pipelines YAML changes, queue a build, and poll it until completion”; the source does not define a more specific trigger syntax.

What are this skill's strengths and limitations?

Pros
  • Covers the full validation loop: queueing, monitoring, log and artifact retrieval, and cancellation.
  • Supports filtering by branch, definition, reason, and build ID, including raw JSON output.
  • Build parameters can reduce the validation matrix for faster iteration.
  • Dry-run support and configurable polling intervals help avoid unnecessary actions and API requests.
Limitations
  • It is specifically configured for the VS Code Monaco project and pipeline definition 111, not arbitrary Azure Pipelines projects.
  • It requires Node.js, Azure CLI, the Azure DevOps extension, Git, network access, and suitable Azure DevOps permissions.
  • The source provides no standalone installation method, automated test suite, or evidence for other Azure DevOps projects.
  • Builds can still take time; the skill provides queueing and monitoring workflows but does not guarantee a successful build.

How does this skill compare with similar options?

Side by side with related skills; every score comes from the same FSRS standard.

Skill FS score Stars Last updated License
Azure Pipelines Validation Assistant this page ✓ Microsoft · Official 47 · Use with care ★ 194k 11d ago MIT
TAO Workflow Launch Gate ✓ NVIDIA · Official 60 · Recommended ★ 3.6k 11d ago Apache-2.0
AKS Automatic Readiness ✓ Microsoft · Official 55 · Use with care ★ 2.7k 3mo ago MIT
Isaac for Healthcare E2E Workflow ✓ NVIDIA · Official 45 · Not recommended ★ 3.6k 11d ago Apache-2.0
TweetClaw: X/Twitter Search & Automation for OpenClaw 67 · Recommended ★ 94 8d ago MIT

Compared with pushing a change and waiting for full CI feedback, this skill provides a faster manual workflow for queueing parameterized validation builds, polling their status, and cancelling obsolete runs. The source names no other specific competing tools, so no further comparison is made.

How did FollowSkills review this skill?

FollowSkills review · FSRS-2.0
Use with care
47/ 100 5-point scale 2.4 / 5
The upstream repository has new commits since this review. The score still applies to the reviewed revision shown and may not cover the latest changes.
1Trust13 / 25 · 2.6/5

The script includes input validation, uses shell:false, cleans temporary files, and offers a cancel dry-run, reducing command-injection and path risks. However, it authenticates to Azure DevOps and can queue, cancel, publish, or trigger release builds; publishing defaults to true, while explicit per-action confirmation, permission scoping, sensitive-token handling, and complete rollback guidance are missing, so 12 points are deducted.

2Reliability8 / 20 · 2.0/5

The document covers queueing, status checks, polling, cancellation, and troubleshooting, while the script provides validation and some error messages. However, several status-query failures are silently converted to empty results, documentation constraints conflict with examples such as CI Build/Product Build, and no skill-specific tests or reproducible static evidence are supplied; the static ceiling requires a deduction.

3Adaptability7 / 15 · 2.3/5

The intended scenario and primary commands are reasonably clear, with support for branches, parameters, status, logs, and artifacts. Non-fit boundaries, trigger semantics, output contracts, and Chinese-language guidance are not defined, and the core workflow depends on Azure CLI, Azure DevOps authentication, and services that may have mainland-China network reachability constraints, so 8 points are deducted.

4Convention7 / 15 · 2.3/5

The SKILL.md has clear sections for prerequisites, commands, options, workflows, parameter tables, and troubleshooting. Repository context supplies MIT licensing and Microsoft attribution, but the skill lacks versioning, changelog, explicit maintenance ownership, and an update path; documentation also conflicts with examples, so 8 points are deducted.

5Effectiveness7 / 15 · 2.3/5

The skill covers the core tasks of queueing builds, checking status, downloading logs and artifacts, and cancelling builds with copyable commands. However, defaults can create significant external side effects, results depend on external Azure state, and there is no verified output, explicit success criterion, or comparison with alternatives; under static calibration this supports only a moderate score and requires an 8-point deduction.

6Verifiability5 / 10 · 2.5/5

The supplied files expose auditable commands, constants, validation logic, and Azure API calls, providing limited traceability. There are no committed tests covering the skill's key paths, real CI execution records, or cross-source corroboration, so the score is capped at 5 under static review.

1 2 3 4 5 6

Open a dimension to read why it scored that way

Reviewed Jul 20, 2026 Reviewed revision 5b3e1be7be9e Review evidence[1][2][3][4][5][6][7][8][9][10][11][12]

Evidence confidence:Low — Mostly static review, author material or a limited demo; useful for discovery, not high-risk decisions.

See the full review method →

FAQ

Does using this skill cost money?
The repository is licensed under MIT, but the source does not state pricing for Azure DevOps build resources or related services. It lists no separate charge for the skill itself.
Which build targets can it validate?
The product-build parameters cover Windows, Linux, Alpine, macOS, and Web targets, with multiple architectures. The selected scope is controlled by the `VSCODE_BUILD_*` parameters.
Why should obsolete builds be cancelled?
The skill explicitly recommends cancelling unneeded builds on the same branch to free build agents and reduce resource waste before queueing a new build.
Can it provide detailed failure information?
Yes. Use `status --build-id <id>` to view stages, artifacts, and log IDs, then use `--download-log <id>` to download a selected log to `/tmp`.

More skills from this repository

All from microsoft/vscode

Dev & Engineering ✓ Microsoft · Official

VS Code Smoke Test Assistant

Run, filter, and debug VS Code end-to-end smoke tests.

★ 194k FS 53 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

VS Code Smoke Test Failure Diagnosis

Diagnose and validate intermittent VS Code Electron smoke-test failures in Azure DevOps.

★ 194k FS 45 Not recommended 11d ago
Dev & Engineering ✓ Microsoft · Official

Context7 Project Bootstrapper

Build a complete VS Code project scaffold using current library documentation.

★ 194k FS 36 Not recommended 11d ago
Dev & Engineering ✓ Microsoft · Official

VS Code Telemetry Error Fix Guide

Trace unhandled telemetry errors to invalid-data producers instead of masking the crash site.

★ 194k FS 52 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

Create Draft Pull Request

Validate the current session’s changes and open a draft PR through GitHub MCP.

★ 194k FS 38 Not recommended 11d ago
Dev & Engineering ✓ Microsoft · Official

Copilot Chat OpenTelemetry Instrumentation

A repository-specific guide for consistent OpenTelemetry instrumentation in Copilot Chat.

★ 194k FS 60 Recommended 11d ago
Dev & Engineering ✓ Microsoft · Official

Agent Host Log Investigator

Trace session, transport, and host failures in Agent Host debug exports.

★ 194k FS 55 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

Memory Leak Audit

Systematically find and fix listener, lifecycle, and disposable leaks in VS Code code.

★ 194k FS 52 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

Tool Rename Compatibility Check

Protect existing prompts and tool configurations when built-in tools are renamed.

★ 194k FS 63 Recommended 11d ago
Dev & Engineering ✓ Microsoft · Official

VS Code Configuration Policy Maintainer

Standardize VS Code policy registration, export, and validation.

★ 194k FS 59 Recommended 11d ago
Design & Frontend ✓ Microsoft · Official

VS Code Design Philosophy

Turn vague UI discomfort into concrete fixes using shared values, principles, and design moves.

★ 194k FS 58 Recommended 11d ago
Dev & Engineering ✓ Microsoft · Official

Agent Host E2E Test Assistant

Maintain VS Code Agent Host end-to-end tests with strict replay fixtures.

★ 194k FS 56 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

Commit Assistant

Creates repository-style commit messages and safely commits code changes.

★ 194k FS 56 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

VS Code Integrated Browser Architecture

A practical architecture guide for safely changing VS Code's cross-process integrated browser.

★ 194k FS 56 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

VS Code Agents Window Sessions

Safely implement and repair VS Code Agents window features.

★ 194k FS 56 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

VS Code Agent Customization Assistant

Create, repair, and troubleshoot VS Code Agent customization files and their loading behavior.

★ 194k FS 55 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

VS Code Unit Test Runner

Run VS Code repository unit tests by file, test name, or compiled-output glob.

★ 194k FS 55 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

VS Code Accessibility Development Guide

A practical specification for accessible interactive features in VS Code.

★ 194k FS 54 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

Code OSS Launch & Debug

Launch a built-from-source VS Code with isolated profiles, Playwright control, and multi-process debugging ports.

★ 194k FS 54 Use with care 11d ago
Design & Frontend ✓ Microsoft · Official

VS Code CSS Layout Standards

Build reliable VS Code-style CSS layouts and text truncation behavior

★ 194k FS 54 Use with care 11d ago

Related skills