Dev & Engineering

Autonomous Agent Harness

Designs autonomous agent loops that remain controlled, recoverable, and auditable.

49/ 100
Use with care

Useful, but reliability, evidence or controls still have material gaps.

See how it was scored ↓
Works as-is in
Codex · Claude Code
Stars
★ 18k
Last updated
16d ago
License
MIT
harness-engineeringautonomous-workflowsevaluation-gatesdurable-logging
+2rollbackhuman-approval

What does this skill do, and when should you use it?

Harness Engineering is for designing the control system around an agent: its editable surfaces, feedback channels, durable state, recovery behavior, and approval boundaries. It covers research loops, evaluation scaffolds, locked and editable surfaces, durable logs, novelty gates, pruning, rollback, PR preparation, and human review. The skill is most relevant when agents must operate for long periods without weakening their own evaluators or taking irreversible actions. The repository is MIT-licensed and distributes this skill alongside 22 other separate skills.

Helps divide an agent environment into locked, editable, append-only, and human-controlled surfaces; define keep, discard, crash, timeout, rollback, and review states; persist plans, source queues, results, failures, and handoffs in files; add source retrieval, novelty checks, mechanism registries, and pruning to research-to-skill workflows; and design monitoring reports plus PR preparation that stops short of automatic merge or deployment.

Good fit
  • A research team is building an autonomous loop that retrieves sources, evaluates candidates, and proposes skill changes.
  • An engineering team wants an agent to optimize code or prompts while keeping evaluation scripts and metrics locked.
  • A platform team needs background agents to run for hours or days and recover from compaction or interruptions through thread and result logs.
  • A maintainer wants an agent to prepare a branch, run checks, and draft a PR while retaining merge, deployment, and destructive actions for human approval.
  • A system designer needs to detect duplicate mechanisms, preserve failed attempts, and prune growing experiment stacks.

How do you install this skill?

Before you use it
  • This is a low-confidence static review; no scripts, tests, or examples were executed.
  • Implementation should add explicit credential and sensitive-data isolation, network and filesystem permissions, crash and timeout recovery, rollback boundaries, and user-confirmation rules.
  • External resources and internal references were not individually verified in the supplied material; repository-level CI claims should not be treated as executed validation of this skill.
Before you start
Your agent needs
  • Network access
  • Local filesystem

Add the repository as a plugin directory, or copy the skill directory into a project skill directory. For a Codex project, create .codex/skills/ and copy skills/harness-engineering into it; Claude Code projects can use .claude/skills/, and Cursor projects can use .cursor/skills/. Keep the directory layout intact rather than flattening SKILL.md into one file. The repository is licensed under MIT.

Generic route: install into Claude Code manually (macOS / Linux)
tmp="$(mktemp -d)"
git clone --depth 1 https://github.com/muratcankoylan/Agent-Skills-for-Context-Engineering.git "$tmp"
mkdir -p ~/.claude/skills
cp -R "$tmp/skills/harness-engineering" ~/.claude/skills/
rm -rf "$tmp"

Generated from the source repository and skill path; it copies only this skill's folder. If the author's install steps above differ, follow those first. To scope it to one project, replace ~/.claude/skills with that project's .claude/skills.

How do you use this skill?

Try saying

Once installed, send your agent any of these to trigger it:

  • Design an autonomous research loop with a locked evaluator, append-only results log, failure rollback, and human merge approval.

In an Agent Skills-compatible client, request a harness-design task such as: “Design an autonomous research loop with a locked evaluator, append-only results log, failure rollback, and human merge approval.” The skill then frames the design around editable surfaces, feedback, persistence, and governance. A client-specific activation command is not documented in the skill.

What are this skill's strengths and limitations?

Pros
  • Provides a clear model for separating agent-editable content from locked and human-controlled surfaces.
  • Covers durable logs, rejected attempts, rollback, novelty checks, and pruning for long-running loops.
  • Includes concrete patterns for autoresearch-style optimization, research-to-skill workflows, and auto-PR preparation.
  • Addresses metric gaming, missing retrieval evidence, stale monitoring, and ambiguous approval boundaries.
Limitations
  • It primarily provides design guidance, workflows, and pseudocode; the skill content does not include a directly runnable implementation.
  • It does not provide complete configuration examples for a specific client, deployment environment, or runtime.
  • No independent test suite or measured performance evidence is shown for this individual skill, so target-environment validation remains necessary.
  • It discusses source refresh and file-based state but does not prescribe a particular network service, storage backend, or permission model.

How does this skill compare with similar options?

Side by side with related skills; every score comes from the same FSRS standard.

Skill FS score Stars Last updated License
Autonomous Agent Harness this page 49 · Use with care ★ 18k 16d ago MIT
Long-Horizon Prompting 57 · Use with care ★ 18k 16d ago MIT
Context Engineering for Production Agents 44 · Not recommended ★ 18k 16d ago MIT
Self-Improvement Loops 58 · Recommended ★ 18k 16d ago MIT
Harness Creator: Harness Engineering for AI Coding Agents 56 · Use with care ★ 20k 27d ago MIT

This skill differs from the repository’s evaluation skill, which covers general evaluation frameworks and quality gates; Harness Engineering focuses on autonomous control surfaces, persistence, rollback, and approval. It is also distinct from tool-design, which covers tool contracts and recovery errors, and hosted-agents, which covers remote sandbox and hosted-session infrastructure.

How did FollowSkills review this skill?

FollowSkills review · FSRS-2.0
Use with care
49/ 100 5-point scale 2.5 / 5
The upstream repository has new commits since this review. The score still applies to the reviewed revision shown and may not cover the latest changes.
1Trust12 / 25 · 2.4/5

The skill explicitly separates locked, editable, append-only, and human-controlled surfaces, and requires rollback, durable logs, and human approval for merge and deployment. It does not address sensitive-data handling, credential isolation, dependency security, general data-flow disclosure, or recovery procedures in sufficient detail, so points are deducted.

2Reliability8 / 20 · 2.0/5

The instructions are internally coherent and cover keep, discard, crash, timeout, and review states with useful loops and checklists. However, the skill contains no executable scripts, tests, or concrete abnormal-input and failure-message examples, so key paths cannot be reproduced statically; the score remains conservative under the static cap.

3Adaptability11 / 15 · 3.7/5

Activation scenarios are specific, and adjacent non-fit areas are explicitly assigned to other skills such as evaluation, tool-design, project-development, and hosted-agents. It does not define standard inputs and outputs, broader non-fit boundaries, Chinese-language usage, or mainland-China environment compatibility, so points are deducted.

4Convention9 / 15 · 3.0/5

The document is well organized, with concepts, detailed topics, practical checklists, file layout, examples, gotchas, and integrations. Repository evidence supplies an MIT license, while the skill includes creation date, update date, author, and version. It lacks a skill-specific changelog, clearly assigned maintenance responsibility, and an explicit update path; referenced internal documents were not supplied in the evidence.

5Effectiveness6 / 15 · 2.0/5

Guidance on locked evaluators, narrow edit surfaces, durable logs, novelty gates, and human approval is directly actionable for harness design, and the examples cover representative patterns. The output is conceptual rather than runnable, and cited internal runbooks are unavailable here, leaving substantial implementation and validation work; the static cap therefore applies.

6Verifiability3 / 10 · 1.5/5

The skill names several external research and engineering references, providing limited traceability. It supplies no precise citations or locations and no committed tests or evidence covering this skill’s key paths; nothing was executed in this review, so only limited credit is justified.

1 2 3 4 5 6

Open a dimension to read why it scored that way

Reviewed Jul 20, 2026 Reviewed revision c578e85e40fe Review evidence[1][2][3][4][5][6][7][8]

Evidence confidence:Low — Mostly static review, author material or a limited demo; useful for discovery, not high-risk decisions.

See the full review method →

FAQ

Does this skill run or deploy an agent for me?
No. It provides design patterns for autonomous loops and explicitly keeps merging, deployment, credentials, and destructive actions within human approval boundaries.
Does it require network access or a specific dependency?
The described workflows include upstream source refresh and source retrieval, so practical research loops may need network access. No mandatory language, framework, or third-party service is specified.
Is it suitable for ordinary evaluation work?
For standalone metrics, regression suites, or quality gates, the repository’s `evaluation` skill is the closer fit. This skill is for evaluation embedded in an autonomous control loop.

More skills from this repository

All from muratcankoylan/Agent-Skills-for-Context-Engineering

Dev & Engineering

Long-Horizon Prompting

Designs auditable launch briefs for autonomous agents and parallel multi-agent work on difficult, long-running tasks.

★ 18k FS 57 Use with care 16d ago
Dev & Engineering

Context Engineering for Production Agents

A structured guide to designing, optimizing, and evaluating production agent systems with reliable context management.

★ 18k FS 44 Not recommended 16d ago
Dev & Engineering

Self-Improvement Loops

Evolve agent harnesses, workflows, and context mechanisms under bounded, evidence-based evaluation.

★ 18k FS 58 Recommended 16d ago
Dev & Engineering

Agent Evaluation Methods

Build repeatable evaluation, regression detection, and quality gates for agent pipelines.

★ 18k FS 46 Use with care 16d ago
Dev & Engineering

Advanced LLM Evaluation

Build auditable, calibrated LLM-output evaluations with explicit rubrics, confidence scoring, and bias controls.

★ 18k FS 56 Use with care 16d ago
Dev & Engineering

Context Engineering Fundamentals

Understand and shape reliable agent context through attention budgets, context-window mechanics, and signal-density principles.

★ 18k FS 55 Use with care 16d ago
Dev & Engineering

Latent Briefing

Share task-relevant orchestrator state with workers through task-guided KV-cache compaction when the inference runtime is controllable.

★ 18k FS 55 Use with care 16d ago
Dev & Engineering

Persistent Semantic Memory Design

Design durable, retrievable agent memory that scales from simple files to temporal knowledge graphs.

★ 18k FS 53 Use with care 16d ago
Dev & Engineering

Context Compression Strategies

Compress long-running agent sessions while preserving files, decisions, risks, and next actions.

★ 18k FS 50 Use with care 16d ago
Dev & Engineering

Agent Skill Blueprint

A reusable structure for authoring well-scoped context-engineering skills.

★ 18k FS 40 Not recommended 16d ago
Dev & Engineering

Multi-Agent Architecture Patterns

Design multi-agent systems with context isolation, explicit handoffs, coordinated execution, and controlled failure handling.

★ 18k FS 55 Use with care 16d ago
Dev & Engineering

Context Degradation Diagnosis

Identify and mitigate lost attention, poisoning, distraction, confusion, and conflict in long agent contexts.

★ 18k FS 51 Use with care 16d ago
Dev & Engineering

Agent Tool Design Guide

Design tool interfaces agents can route, call, and recover from reliably.

★ 18k FS 51 Use with care 16d ago
Dev & Engineering

Project Development Methodology

Decide whether an LLM fits the job, then design a staged agent pipeline with predictable parsing, iteration, and cost control.

★ 18k FS 50 Use with care 16d ago
Dev & Engineering

BDI Mental State Modeling

Turn RDF context into explainable belief, desire, and intention chains.

★ 18k FS 49 Use with care 16d ago
Dev & Engineering

Rigorous Research Agent

A validation, recovery, and source-tracking protocol for multi-step research.

★ 18k FS 45 Not recommended 16d ago
Dev & Engineering

Filesystem Context Engineering

Move large, durable, or shared agent context into files and retrieve it selectively when needed.

★ 18k FS 45 Not recommended 16d ago
Dev & Engineering

Context Efficiency Optimizer

Reduce context cost with caching, masking, compaction, and partitioning while preserving answer quality.

★ 18k FS 44 Not recommended 16d ago
Productivity & Collaboration

Digital Brain Personal OS

Manage content, relationships, knowledge, and goals through structured files and AI.

★ 18k FS 38 Not recommended 16d ago
Dev & Engineering

Reasoning Trace Optimizer

Diagnose context, tool, and instruction failures by analyzing agent traces and iteratively improving prompts.

★ 18k FS 38 Not recommended 16d ago

Related skills