Automation & Ops ✓ Microsoft · Official

CI Failure Fixer

Diagnose pull request CI failures and iterate toward a fix.

48/ 100
Use with care

Useful, but reliability, evidence or controls still have material gaps.

See how it was scored ↓
Works as-is in
Codex · Claude Code
Stars
★ 194k
Last updated
11d ago
License
MIT
ci-failure-diagnosisgithub-actionsgh-clipull-requests
+2log-analysisgit

What does this skill do, and when should you use it?

This skill is for developers who have a pull request branch checked out locally and need to investigate failed CI. It uses Git and the GitHub CLI to find the branch’s PR, inspect failed checks, retrieve job logs and artifacts, and identify test, build, network, or infrastructure causes. After diagnosis, it guides local verification, committing, pushing, and watching CI again. It explicitly requires the gh CLI and focuses on CI failure investigation rather than general code review or testing.

Reads the current Git branch and calls gh pr view to locate its pull request; uses gh pr checks to list all or failed checks and optionally wait for completion; extracts a run ID from a check link and uses gh run view to list failed jobs; retrieves failed-step logs with gh run view --log-failed, artifacts with gh run download, or per-job logs with gh api; searches logs with grep, tail, and sed for error annotations, assertion failures, TypeScript errors, network failures, and timeouts; checks recent main-branch runs to assess whether a failure is related to the PR; and guides local changes, type checking, relevant tests, commits, pushes, and failed-job reruns.

Good fit
  • A developer has a PR branch checked out and needs to identify which GitHub Actions check and job failed.
  • An integration or extension test failed and the developer needs exthost.log, terminal.log, main.log, or crash-dump artifacts for diagnosis.
  • A build, TypeScript, ESLint, or stylelint check failed and the developer needs the exact error from the failed-step output.
  • A failed job has finished while the overall CI run is still in progress, requiring direct retrieval of the job log through the GitHub API.
  • A failure may be caused by networking, an Electron download, disk or memory pressure, or a test flake, and the developer needs to decide whether to rerun instead of changing code.

How do you install this skill?

Before you use it
  • Obtain explicit user confirmation before git add -A, commit, push, or gh run rerun, and constrain the target files, branch, and run.
  • CI logs and artifacts may contain tokens, paths, internal data, or test credentials; the skill gives no redaction, minimal-download, or secure-storage guidance.
  • The /dev/null download probe, fixed artifact names, and grep/tail parsing depend on environment and repository conventions and may require manual adjustment.
  • There is no skill-specific execution evidence; no command was run and successful CI remediation was not verified in this static review.
  • Core GitHub CLI and GitHub Actions access depends on overseas services; the skill provides no alternative for restricted mainland-China connectivity.
Before you start
Your agent needs
  • Shell / CLI
  • Network access
  • Local filesystem
Install first
  • Git
  • GitHub CLI (gh)

The source does not document a skill-specific installation command or client registration procedure. The skill file is located at https://github.com/microsoft/vscode/tree/main/.github/skills/fix-ci-failures and is one of 61 skills bundled in microsoft/vscode. The repository source is licensed under MIT.

Generic route: install into Claude Code manually (macOS / Linux)
tmp="$(mktemp -d)"
git clone --depth 1 https://github.com/microsoft/vscode.git "$tmp"
mkdir -p ~/.claude/skills
cp -R "$tmp/.github/skills/fix-ci-failures" ~/.claude/skills/
rm -rf "$tmp"

Generated from the source repository and skill path; it copies only this skill's folder. If the author's install steps above differ, follow those first. To scope it to one project, replace ~/.claude/skills with that project's .claude/skills.

How do you use this skill?

Try saying

Once installed, send your agent any of these to trigger it:

  • Investigate the CI failures for the current PR, identify the root cause, and guide me through the fix.

Check out the PR branch locally, install the GitHub CLI, and ask a compatible Agent something like: “Investigate the CI failures for the current PR, identify the root cause, and guide me through the fix.” The workflow can use: gh pr view --json number,title,url,statusCheckRollup; gh pr checks --json name,state,link,bucket; gh run view <RUN_ID> --json jobs; and gh run view <RUN_ID> --job <JOB_ID> --log-failed. If the run is still in progress, retrieve a completed job log with gh api repos/microsoft/vscode/actions/jobs/<JOB_ID>/logs > "$TMPDIR/ci-job-log.txt". After the fix, the workflow guides verification, git commit, git push, and another gh pr checks --watch --fail-fast.

What are this skill's strengths and limitations?

Pros
  • Covers the full path from finding the PR and failed check to retrieving evidence, assessing the cause, and iterating on a fix.
  • Provides three evidence paths: failed-step logs, run artifacts, and API-based per-job logs while a run is still active.
  • Includes concrete ways to distinguish code defects from infrastructure failures and test flakes.
  • Explains the roles of main.log, terminal.log, and exthost.log in typical VS Code log artifacts.
Limitations
  • Requires the GitHub CLI, Git, network access, a local shell, and filesystem access.
  • Assumes the user has already checked out a PR branch; if no PR is found, the user must provide a PR number.
  • The skill does not document standalone installation or client configuration.
  • Its workflow and artifact naming examples target GitHub Actions and the VS Code repository, so other CI systems or repositories may require adaptation.
  • There is no evidence that it automatically edits code or guarantees a successful fix; the user must review and execute those steps.

How does this skill compare with similar options?

Side by side with related skills; every score comes from the same FSRS standard.

Skill FS score Stars Last updated License
CI Failure Fixer this page ✓ Microsoft · Official 48 · Use with care ★ 194k 11d ago MIT
GitHub PR Check Fixer ✓ OpenAI · Official 47 · Use with care ★ 28k 4mo ago —
React Native GitHub Actions Artifacts 49 · Use with care ★ 1.7k 17d ago MIT
Megatron-Core CI Failure to Issue ✓ NVIDIA · Official 46 · Use with care ★ 3.6k 11d ago Apache-2.0
CI Push Approval Assistant ✓ OpenAI · Official 45 · Not recommended ★ 129k 11d ago Apache-2.0

How did FollowSkills review this skill?

FollowSkills review · FSRS-2.0
Use with care
48/ 100 5-point scale 2.4 / 5
The upstream repository has new commits since this review. The score still applies to the reviewed revision shown and may not cover the latest changes.
1Trust12 / 25 · 2.4/5

The skill explicitly uses gh, GitHub Actions logs, and artifacts, and partially describes the data flow. However, it includes external and persistent actions such as gh run rerun, git add -A, commit, and push without stepwise user confirmation, least-privilege guidance, sensitive-log redaction, rollback instructions, or recovery procedures. Microsoft provenance and the MIT license support attribution but do not increase safety capability.

2Reliability8 / 20 · 2.0/5

The workflow, commands, alternate API log path, and common failure patterns are reasonably clear. Reliability is reduced by dependencies on gh, repository state, network access, permissions, platform-specific assumptions, exact artifact names, and mutable log formats. Input validation and controlled, diagnosable failure handling are limited. Static calibration also requires deducting for the absence of execution verification.

3Adaptability10 / 15 · 3.3/5

The audience and scenario are clear: VS Code contributors with a PR branch checked out and failing CI checks. It covers build, test, infrastructure, and flaky failures. Boundaries are incomplete for missing PRs, insufficient permissions, non-GitHub checks, different repository layouts, or non-standard artifacts; the response mainly shifts these cases to the user. Chinese-language interaction and mainland-China reachability are not addressed, so points are deducted.

4Convention6 / 15 · 2.0/5

The SKILL.md has front matter, a staged workflow, command examples, failure categories, and a quick reference. The supplied README, LICENSE, and package.json provide repository attribution, MIT licensing, and version context. The skill lacks its own version, changelog, maintainer, update path, installation notes, parameter constraints, confirmation policy, rollback guidance, and FAQ; several instructions rely on repository-specific conventions.

5Effectiveness7 / 15 · 2.3/5

The skill provides a usable sequence for finding the PR, locating failed checks, retrieving logs, classifying causes, and iterating on a fix. However, the supplied files do not prove that the key paths were executed, repair quality depends on the user interpreting logs and editing code, and the push and CI-rerun loop is not verified end to end. The static ceiling supports 7, with deductions for missing execution evidence and incomplete closure.

6Verifiability5 / 10 · 2.5/5

The commands, GitHub Actions log annotations, artifact layout, and repository naming conventions provide auditable primary evidence. There is no skill-specific test suite, example session, versioned behavioral verification, or third-party execution record, and the supplied workflows and tests do not cover the skill's key paths. Therefore it receives the static-review ceiling of 5, not a higher score.

1 2 3 4 5 6

Open a dimension to read why it scored that way

Reviewed Jul 20, 2026 Reviewed revision 5b3e1be7be9e Review evidence[1][2][3][4][5][6][7][8][9][10][11]

Evidence confidence:Low — Mostly static review, author material or a limited demo; useful for discovery, not high-risk decisions.

See the full review method →

FAQ

Does this skill cost money to use?
The source does not list a skill fee. The microsoft/vscode repository source is MIT-licensed; the workflow requires the GitHub CLI to access pull requests, checks, logs, and artifacts.
Can it handle CI that is still running?
Yes. It can wait with gh pr checks --watch --fail-fast. If a failed job has completed while the overall run is still active, it can retrieve that job’s log through gh api.
Does it assume every CI failure is caused by my code?
No. The workflow checks the changed area, test relevance, matching failures on main, and infrastructure signals such as network timeouts, Electron download failures, disk exhaustion, and test flakes.
Is it suitable for a local branch with no pull request?
Not completely. The core workflow starts by using gh pr view to find a pull request for the current branch; if none is found, the source says the user may need to provide the PR number.

More skills from this repository

All from microsoft/vscode

Dev & Engineering ✓ Microsoft · Official

CI Component Screenshot Baseline Investigator

Investigate component screenshot differences from CI comments and captured artifacts.

★ 194k FS 37 Not recommended 11d ago
Dev & Engineering ✓ Microsoft · Official

VS Code Smoke Test Assistant

Run, filter, and debug VS Code end-to-end smoke tests.

★ 194k FS 53 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

Session Pull Request Assistant

Checks session changes and creates a GitHub pull request through GitHub MCP.

★ 194k FS 43 Not recommended 11d ago
Dev & Engineering ✓ Microsoft · Official

Code OSS Development Log Viewer

Locate and inspect the latest Code OSS development logs.

★ 194k FS 51 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

VS Code Smoke Test Failure Diagnosis

Diagnose and validate intermittent VS Code Electron smoke-test failures in Azure DevOps.

★ 194k FS 45 Not recommended 11d ago
Dev & Engineering ✓ Microsoft · Official

Existing Pull Request Updater

Sync the branch, run checks, and publish new changes to an existing pull request.

★ 194k FS 32 Not recommended 11d ago
Dev & Engineering ✓ Microsoft · Official

Copilot Session Troubleshooter

Explain unexpected Copilot CLI behavior from session-log evidence.

★ 194k FS 51 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

Create Draft Pull Request

Validate the current session’s changes and open a draft PR through GitHub MCP.

★ 194k FS 38 Not recommended 11d ago
Dev & Engineering ✓ Microsoft · Official

Agent Host E2E Test Assistant

Maintain VS Code Agent Host end-to-end tests with strict replay fixtures.

★ 194k FS 56 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

Copilot Chat Troubleshooter

Explain unexpected agent behavior, latency, and tool failures from Copilot Chat debug logs.

★ 194k FS 49 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

Chronicle Copilot Session Analyst

Turn Copilot session history into standups, usage advice, and searchable records.

★ 194k FS 39 Not recommended 11d ago
Dev & Engineering ✓ Microsoft · Official

Commit Assistant

Creates repository-style commit messages and safely commits code changes.

★ 194k FS 56 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

VS Code Chat Performance Lab

Benchmark chat rendering and detect memory growth across VS Code builds.

★ 194k FS 53 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

CPU Profile Analyzer

Find performance bottlenecks in V8 and DevTools performance files.

★ 194k FS 52 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

VS Code Telemetry Error Fix Guide

Trace unhandled telemetry errors to invalid-data producers instead of masking the crash site.

★ 194k FS 52 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

Project Instruction Builder

Turn conversation patterns and preferences into a durable project instruction file.

★ 194k FS 51 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

Session Code Review

Review the current session's code changes and place actionable findings directly on the relevant lines.

★ 194k FS 51 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

Workflow Skill Builder

Turns a conversation's working method into a reusable SKILL.md.

★ 194k FS 50 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

Branch Merge Assistant

Safely merges session work from a topic branch back into its base branch.

★ 194k FS 49 Use with care 11d ago
Dev & Engineering ✓ Microsoft · Official

Git Branch Sync

Safely sync an upstream branch or publish the current session branch to a remote.

★ 194k FS 49 Use with care 11d ago

Related skills