Dev & Engineering ✓ NVIDIA · Official

NeMo AutoModel Recipe Development

Build, modify, and validate NeMo AutoModel training and evaluation recipes.

55/ 100
Use with care

Useful, but reliability, evidence or controls still have material gaps.

See how it was scored ↓
Works as-is in
Codex · Claude Code
Stars
★ 3.8k
Last updated
today
License
Apache-2.0
nemo-automodelrecipe-developmentyaml-configurationdistributed-training
+2checkpointingpytorch

What does this skill do, and when should you use it?

This skill supports development of NeMo AutoModel training, fine-tuning, and evaluation recipes. It explains YAML structure, `_target_` callables, component builders, CLI routing, and execution flow. Coverage includes concrete recipe guidance for LLMs, VLMs, diffusion, and retrieval. It also specifies key settings for validation, checkpointing, resume, and local testing.

Guides an agent to locate recipe files and YAML sections under nemo_automodel/recipes/, identify builders for the model, optimizer, dataloaders, loss, schedulers, and checkpointing, and explain how _target_ invokes a fully qualified Python callable with keyword arguments. It provides minimal YAML and CLI override examples, including automodel finetune llm -c <config.yaml>, and helps check validation cadence, checkpoint cadence, restore paths, batch-size arithmetic, CLI route registration, and dataset-collator/model-shape mismatches.

Good fit
  • A NeMo AutoModel developer is adding an LLM fine-tuning or pretraining recipe variant and needs the relevant file, builders, CLI route, example YAML, and test path.
  • A training engineer is adding YAML fields for an optimizer, dataset, or scheduler and needs to understand `_target_` and nested CLI overrides.
  • A model engineer is configuring validation data, validation intervals, checkpoint intervals, or resume-from-checkpoint behavior.
  • A troubleshooter is investigating a first-step crash, forward shape mismatch, validation OOM, or checkpoint restore failure within a recipe.
  • A test author needs a small CPU-compatible unit test for a new recipe.

How do you install this skill?

Before you use it
  • Before use, verify the current NeMo AutoModel version, actual module paths, and CLI behavior; examples may drift from upstream.
  • Do not treat the guidance as a validated training configuration; confirm data, model, checkpoint paths, resource costs, and overwrite risks before execution.
  • Add negative-trigger evaluations, rerunnable skill-specific tests, a compatibility matrix, named maintenance ownership, and a changelog.
Before you start
Your agent needs
  • Shell / CLI
  • Local filesystem
Install first
  • NeMo AutoModel
  • automodel CLI
  • PyTorch

Install the specific skill with the command documented in the repository README: npx skills add nvidia/skills --skill nemo-automodel-recipe-development --yes. Add --agent codex to target Codex. The provided source does not specify other installation methods or version requirements.

Generic route: install into Claude Code manually (macOS / Linux)
tmp="$(mktemp -d)"
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp"
mkdir -p ~/.claude/skills
cp -R "$tmp/skills/nemo-automodel-recipe-development" ~/.claude/skills/
rm -rf "$tmp"

Generated from the source repository and skill path; it copies only this skill's folder. If the author's install steps above differ, follow those first. To scope it to one project, replace ~/.claude/skills with that project's .claude/skills.

How do you use this skill?

After installation, ask the agent about a recipe task, for example: Create a new NeMo AutoModel LLM fine-tuning recipe variant and identify the YAML, builder functions, CLI route, and CPU validation command. A recipe can be launched with automodel finetune llm -c config.yaml, with nested overrides such as --optimizer.lr and --step_scheduler.max_steps.

What are this skill's strengths and limitations?

Pros
  • Covers recipe YAML, builders, CLI routes, execution flow, training-loop details, validation, and checkpoint configuration.
  • Includes concrete configuration structures, commands, execution ordering, and common failure modes.
  • Defines a clear boundary around recipe construction and execution-flow questions.
Limitations
  • It is focused on recipe development and does not cover standalone cluster launchers or distributed-strategy selection.
  • The provided material does not enumerate this skill's own test files, platform matrix, or version compatibility range.
  • Examples depend on the corresponding NeMo AutoModel repository and `automodel` environment being available.

How does this skill compare with similar options?

Side by side with related skills; every score comes from the same FSRS standard.

Skill FS score Stars Last updated License
NeMo AutoModel Recipe Development this page ✓ NVIDIA · Official 55 · Use with care ★ 3.8k today Apache-2.0
NeMo AutoModel Distributed Training ✓ NVIDIA · Official 58 · Recommended ★ 3.8k today Apache-2.0
Remote GPU Trainer Skill 65 · Recommended ★ 42 today MIT
NeMo MBridge GPU Memory Tuning ✓ NVIDIA · Official 61 · Recommended ★ 3.8k today Apache-2.0
NeMo MBridge Training Resiliency ✓ NVIDIA · Official 57 · Use with care ★ 3.8k today Apache-2.0

How did FollowSkills review this skill?

FollowSkills review · FSRS-2.0
Use with care
55/ 100 5-point scale 2.8 / 5
The upstream repository has new commits since this review. The score still applies to the reviewed revision shown and may not cover the latest changes.
1Trust17 / 25 · 3.4/5

The skill mainly provides configuration and development guidance, requests no credentials, network access, or elevated permissions, and explicitly warns against exposing secrets in prompts, logs, or output, so no red-line risk is evident. Points are deducted because user confirmation, rollback, data-flow disclosure, dependency security, and execution-side-effect controls are not specified; attribution is supported by NVIDIA metadata and repository governance material, but the license metadata is NOASSERTION.

2Reliability8 / 20 · 2.0/5

The document provides reasonably clear routing boundaries, execution flow, configuration examples, and common pitfalls; BENCHMARK.md reports accuracy results for three tasks. Points are deducted because this review is static, key paths were not reproduced, no skill-specific test suite is supplied, and abnormal-input, version-compatibility, and failure-feedback behavior is underspecified; static calibration limits the score to 10 or less.

3Adaptability11 / 15 · 3.7/5

The audience, use cases, trigger conditions, and non-fit range are clearly described for recipe construction, training, evaluation, YAML, builders, and CLI routing. Points are deducted because input/output boundaries, negative-trigger examples, and environment prerequisites are not systematically defined, and Chinese-language support is not documented. Core functionality does not entirely depend on an overseas online service, so no additional mainland-China reachability deduction is applied.

4Convention9 / 15 · 3.0/5

The documentation includes front matter, layered sections, examples, routing boundaries, dependency guidance, known pitfalls, benchmark material, and a skill card; the skill declares Apache-2.0 and the repository supplies license text. Points are deducted because versioning, changelog, maintenance ownership, and update path are incomplete; the benchmark reports an author-format issue, and repository license metadata is NOASSERTION.

5Effectiveness6 / 15 · 2.0/5

The skill gives actionable paths, configuration snippets, and commands for new recipes, _target_ usage, validation, and checkpointing; BENCHMARK.md reports 95% Codex correctness and 93% Codex effectiveness across three positive tasks. Points are deducted because coverage is only three positive tasks with no negative cases, and no independently verifiable representative outputs or real project results are included; static calibration limits the score to 7 or less.

6Verifiability4 / 10 · 2.0/5

Revision-pinned source material, evaluation tasks, expected behaviors, and a benchmark report provide some auditability. Points are deducted because evaluation coverage is narrow, no independently rerunnable test suite for this skill is included, and the benchmark results cannot be verified during this static review; static calibration limits the score to 5 or less.

1 2 3 4 5 6

Open a dimension to read why it scored that way

Reviewed Jul 20, 2026 Reviewed revision 55f18499943e Review evidence[1][2][3][4][5][6][7][8][9][10][11][12][13]

Evidence confidence:Low — Mostly static review, author material or a limited demo; useful for discovery, not high-risk decisions.

See the full review method →

FAQ

Will this skill automatically edit repository files?
The source presents it as recipe-development guidance and does not state that it automatically edits files; editing depends on the host agent and the user's request.
Does using it require a GPU or cluster?
The instructions cover distributed-training settings and also require a tiny CPU-compatible test, but they do not claim that complete recipes can train on CPU.
How should checkpoint resume be configured?
Set `restore_from.path` to the checkpoint directory and ensure the model architecture matches the checkpoint. The skill recommends consolidated safetensors as the default format.

More skills from this repository

All from NVIDIA/skills

Dev & Engineering ✓ NVIDIA · Official

NeMo AutoModel Distributed Training

Choose and configure multi-GPU and multi-node training strategies for NeMo AutoModel.

★ 3.8k FS 58 Recommended today
Automation & Ops ✓ NVIDIA · Official

NeMo AutoModel Launcher Configuration

Configure NeMo AutoModel launches across local, Slurm, and cloud runs.

★ 3.8k FS 54 Use with care today
Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge GPU Memory Tuning

Diagnose GPU OOMs in Megatron Bridge training and reduce fragmentation, activation, and PEFT memory usage.

★ 3.8k FS 61 Recommended today
Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge Training Resiliency

Configure fault recovery and hang detection for Megatron Bridge distributed training.

★ 3.8k FS 57 Use with care today
Dev & Engineering ✓ NVIDIA · Official

Megatron FSDP Configuration and Performance Guide

Enable, troubleshoot, and verify Megatron FSDP in Megatron-Bridge.

★ 3.8k FS 54 Use with care today
Dev & Engineering ✓ NVIDIA · Official

DALI Dynamic Mode Assistant

Helps agents write, review, and migrate NVIDIA DALI imperative dynamic-mode code.

★ 3.8k FS 58 Recommended today
Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge Recipe Recommender

Recommends adjustable Megatron Bridge recipes for your model, GPU budget, and training goal.

★ 3.8k FS 53 Use with care today
Dev & Engineering ✓ NVIDIA · Official

Jetson Target Switcher

Switch the active Jetson target among existing platform profiles.

★ 3.8k FS 60 Recommended today
Dev & Engineering ✓ NVIDIA · Official

NeMo AutoModel Model Onboarding

A structured guide for adding new LLM, MoE, and VLM architectures to NeMo AutoModel.

★ 3.8k FS 60 Recommended today
Dev & Engineering ✓ NVIDIA · Official

Megatron Bridge Activation Recompute

Trade extra compute for lower GPU activation memory in Megatron Bridge training.

★ 3.8k FS 59 Recommended today
Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge Parallelism Strategy Guide

Choose, combine, and validate Megatron Bridge parallelism configurations.

★ 3.8k FS 58 Recommended today
Dev & Engineering ✓ NVIDIA · Official

Jetson Target Platform Initializer

Create a Jetson target-platform profile for a reference devkit or custom carrier and update the active pointer.

★ 3.8k FS 57 Use with care today
Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge MoE Expert-Parallel Overlap

Configure, validate, and troubleshoot MoE expert-parallel communication overlap in Megatron-Bridge.

★ 3.8k FS 57 Use with care today
Automation & Ops ✓ NVIDIA · Official

Megatron-LM on SLURM

Launch, monitor, and troubleshoot multi-node Megatron-LM training on SLURM GPU clusters.

★ 3.8k FS 56 Use with care today
Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge CPU Offload

Configure, validate, and troubleshoot CPU offloading in Megatron Bridge to relieve GPU memory pressure.

★ 3.8k FS 55 Use with care today
Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge CUDA Graphs

Configure, validate, and benchmark CUDA Graph capture in Megatron Bridge to reduce host-driver overhead.

★ 3.8k FS 55 Use with care today
Dev & Engineering ✓ NVIDIA · Official

Megatron-Bridge Communication Overlap Guide

Configure and verify TP, DP, and PP communication overlap in Megatron-Bridge training.

★ 3.8k FS 54 Use with care today
Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge MoE Performance Workflow

Systematically diagnose and improve MoE training throughput in Megatron Bridge.

★ 3.8k FS 53 Use with care today
Automation & Ops ✓ NVIDIA · Official

TAO Jobs on Kubernetes

Submit and monitor NVIDIA TAO GPU training jobs through Kubernetes.

★ 3.8k FS 53 Use with care today
Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge Hierarchical Context Parallelism

Enable, troubleshoot, and verify hierarchical context parallelism in Megatron-Bridge.

★ 3.8k FS 51 Use with care today

Related skills