Dev & Engineering harness-engineeringautonomous-workflowsevaluation-gatesdurable-loggingrollbackhuman-approval

Autonomous Agent Harness

Designs autonomous agent loops that remain controlled, recoverable, and auditable.

FollowSkills review · FSRS-2.0
Not recommended
49/ 100 5-point scale 2.5 / 5
Trust12 / 25 · 2.4/5

The skill explicitly separates locked, editable, append-only, and human-controlled surfaces, and requires rollback, durable logs, and human approval for merge and deployment. It does not address sensitive-data handling, credential isolation, dependency security, general data-flow disclosure, or recovery procedures in sufficient detail, so points are deducted.

Reliability8 / 20 · 2.0/5

The instructions are internally coherent and cover keep, discard, crash, timeout, and review states with useful loops and checklists. However, the skill contains no executable scripts, tests, or concrete abnormal-input and failure-message examples, so key paths cannot be reproduced statically; the score remains conservative under the static cap.

Adaptability11 / 15 · 3.7/5

Activation scenarios are specific, and adjacent non-fit areas are explicitly assigned to other skills such as evaluation, tool-design, project-development, and hosted-agents. It does not define standard inputs and outputs, broader non-fit boundaries, Chinese-language usage, or mainland-China environment compatibility, so points are deducted.

Convention9 / 15 · 3.0/5

The document is well organized, with concepts, detailed topics, practical checklists, file layout, examples, gotchas, and integrations. Repository evidence supplies an MIT license, while the skill includes creation date, update date, author, and version. It lacks a skill-specific changelog, clearly assigned maintenance responsibility, and an explicit update path; referenced internal documents were not supplied in the evidence.

Effectiveness6 / 15 · 2.0/5

Guidance on locked evaluators, narrow edit surfaces, durable logs, novelty gates, and human approval is directly actionable for harness design, and the examples cover representative patterns. The output is conceptual rather than runnable, and cited internal runbooks are unavailable here, leaving substantial implementation and validation work; the static cap therefore applies.

Verifiability3 / 10 · 1.5/5

The skill names several external research and engineering references, providing limited traceability. It supplies no precise citations or locations and no committed tests or evidence covering this skill’s key paths; nothing was executed in this review, so only limited credit is justified.

Evidence confidence:Low Reviewed Jul 20, 2026 Reviewed revision c578e85e40fe
Before you use it
  • This is a low-confidence static review; no scripts, tests, or examples were executed.
  • Implementation should add explicit credential and sensitive-data isolation, network and filesystem permissions, crash and timeout recovery, rollback boundaries, and user-confirmation rules.
  • External resources and internal references were not individually verified in the supplied material; repository-level CI claims should not be treated as executed validation of this skill.
Review evidence [1][2][3][4][5][6][7][8]
See the full review method →

What does this skill do, and when should you use it?

Harness Engineering is for designing the control system around an agent: its editable surfaces, feedback channels, durable state, recovery behavior, and approval boundaries. It covers research loops, evaluation scaffolds, locked and editable surfaces, durable logs, novelty gates, pruning, rollback, PR preparation, and human review. The skill is most relevant when agents must operate for long periods without weakening their own evaluators or taking irreversible actions. The repository is MIT-licensed and distributes this skill alongside 22 other separate skills.

Helps divide an agent environment into locked, editable, append-only, and human-controlled surfaces; define keep, discard, crash, timeout, rollback, and review states; persist plans, source queues, results, failures, and handoffs in files; add source retrieval, novelty checks, mechanism registries, and pruning to research-to-skill workflows; and design monitoring reports plus PR preparation that stops short of automatic merge or deployment.

  1. A research team is building an autonomous loop that retrieves sources, evaluates candidates, and proposes skill changes.
  2. An engineering team wants an agent to optimize code or prompts while keeping evaluation scripts and metrics locked.
  3. A platform team needs background agents to run for hours or days and recover from compaction or interruptions through thread and result logs.
  4. A maintainer wants an agent to prepare a branch, run checks, and draft a PR while retaining merge, deployment, and destructive actions for human approval.
  5. A system designer needs to detect duplicate mechanisms, preserve failed attempts, and prune growing experiment stacks.

What are this skill's strengths and limitations?

Pros
  • Provides a clear model for separating agent-editable content from locked and human-controlled surfaces.
  • Covers durable logs, rejected attempts, rollback, novelty checks, and pruning for long-running loops.
  • Includes concrete patterns for autoresearch-style optimization, research-to-skill workflows, and auto-PR preparation.
  • Addresses metric gaming, missing retrieval evidence, stale monitoring, and ambiguous approval boundaries.
Limitations
  • It primarily provides design guidance, workflows, and pseudocode; the skill content does not include a directly runnable implementation.
  • It does not provide complete configuration examples for a specific client, deployment environment, or runtime.
  • No independent test suite or measured performance evidence is shown for this individual skill, so target-environment validation remains necessary.
  • It discusses source refresh and file-based state but does not prescribe a particular network service, storage backend, or permission model.

How do you install this skill?

Add the repository as a plugin directory, or copy the skill directory into a project skill directory. For a Codex project, create .codex/skills/ and copy skills/harness-engineering into it; Claude Code projects can use .claude/skills/, and Cursor projects can use .cursor/skills/. Keep the directory layout intact rather than flattening SKILL.md into one file. The repository is licensed under MIT.

How do you use this skill?

In an Agent Skills-compatible client, request a harness-design task such as: “Design an autonomous research loop with a locked evaluator, append-only results log, failure rollback, and human merge approval.” The skill then frames the design around editable surfaces, feedback, persistence, and governance. A client-specific activation command is not documented in the skill.

How does this skill compare with similar options?

This skill differs from the repository’s evaluation skill, which covers general evaluation frameworks and quality gates; Harness Engineering focuses on autonomous control surfaces, persistence, rollback, and approval. It is also distinct from tool-design, which covers tool contracts and recovery errors, and hosted-agents, which covers remote sandbox and hosted-session infrastructure.

FAQ

Does this skill run or deploy an agent for me?
No. It provides design patterns for autonomous loops and explicitly keeps merging, deployment, credentials, and destructive actions within human approval boundaries.
Does it require network access or a specific dependency?
The described workflows include upstream source refresh and source retrieval, so practical research loops may need network access. No mandatory language, framework, or third-party service is specified.
Is it suitable for ordinary evaluation work?
For standalone metrics, regression suites, or quality gates, the repository’s `evaluation` skill is the closer fit. This skill is for evaluation embedded in an autonomous control loop.

More skills from this repository

All from muratcankoylan/Agent-Skills-for-Context-Engineering

Dev & Engineering

Long-Horizon Prompting

Designs auditable launch briefs for autonomous agents and parallel multi-agent work on difficult, long-running tasks.

Dev & Engineering

Context Engineering for Production Agents

A structured guide to designing, optimizing, and evaluating production agent systems with reliable context management.

Dev & Engineering

Self-Improvement Loops

Evolve agent harnesses, workflows, and context mechanisms under bounded, evidence-based evaluation.

Dev & Engineering

Agent Evaluation Methods

Build repeatable evaluation, regression detection, and quality gates for agent pipelines.

Dev & Engineering

Advanced LLM Evaluation

Build auditable, calibrated LLM-output evaluations with explicit rubrics, confidence scoring, and bias controls.

Dev & Engineering

Context Engineering Fundamentals

Understand and shape reliable agent context through attention budgets, context-window mechanics, and signal-density principles.

Dev & Engineering

Latent Briefing

Share task-relevant orchestrator state with workers through task-guided KV-cache compaction when the inference runtime is controllable.

Dev & Engineering

Persistent Semantic Memory Design

Design durable, retrievable agent memory that scales from simple files to temporal knowledge graphs.

Dev & Engineering

Context Compression Strategies

Compress long-running agent sessions while preserving files, decisions, risks, and next actions.

Dev & Engineering

Agent Skill Blueprint

A reusable structure for authoring well-scoped context-engineering skills.

Dev & Engineering

Multi-Agent Architecture Patterns

Design multi-agent systems with context isolation, explicit handoffs, coordinated execution, and controlled failure handling.

Dev & Engineering

Context Degradation Diagnosis

Identify and mitigate lost attention, poisoning, distraction, confusion, and conflict in long agent contexts.

Dev & Engineering

Agent Tool Design Guide

Design tool interfaces agents can route, call, and recover from reliably.

Dev & Engineering

Project Development Methodology

Decide whether an LLM fits the job, then design a staged agent pipeline with predictable parsing, iteration, and cost control.

Dev & Engineering

BDI Mental State Modeling

Turn RDF context into explainable belief, desire, and intention chains.

Dev & Engineering

Rigorous Research Agent

A validation, recovery, and source-tracking protocol for multi-step research.

Dev & Engineering

Filesystem Context Engineering

Move large, durable, or shared agent context into files and retrieve it selectively when needed.

Dev & Engineering

Context Efficiency Optimizer

Reduce context cost with caching, masking, compaction, and partitioning while preserving answer quality.

Productivity & Collaboration

Digital Brain Personal OS

Manage content, relationships, knowledge, and goals through structured files and AI.

Dev & Engineering

Reasoning Trace Optimizer

Diagnose context, tool, and instruction failures by analyzing agent traces and iteratively improving prompts.

Related skills