Dev & Engineering ✓ NVIDIA · Official nemo-automodelrecipe-developmentyaml-configurationdistributed-trainingcheckpointingpytorch

NeMo AutoModel Recipe Development

Build, modify, and validate NeMo AutoModel training and evaluation recipes.

FollowSkills review · FSRS-2.0
Not recommended
55/ 100 5-point scale 2.8 / 5
Trust17 / 25 · 3.4/5

The skill mainly provides configuration and development guidance, requests no credentials, network access, or elevated permissions, and explicitly warns against exposing secrets in prompts, logs, or output, so no red-line risk is evident. Points are deducted because user confirmation, rollback, data-flow disclosure, dependency security, and execution-side-effect controls are not specified; attribution is supported by NVIDIA metadata and repository governance material, but the license metadata is NOASSERTION.

Reliability8 / 20 · 2.0/5

The document provides reasonably clear routing boundaries, execution flow, configuration examples, and common pitfalls; BENCHMARK.md reports accuracy results for three tasks. Points are deducted because this review is static, key paths were not reproduced, no skill-specific test suite is supplied, and abnormal-input, version-compatibility, and failure-feedback behavior is underspecified; static calibration limits the score to 10 or less.

Adaptability11 / 15 · 3.7/5

The audience, use cases, trigger conditions, and non-fit range are clearly described for recipe construction, training, evaluation, YAML, builders, and CLI routing. Points are deducted because input/output boundaries, negative-trigger examples, and environment prerequisites are not systematically defined, and Chinese-language support is not documented. Core functionality does not entirely depend on an overseas online service, so no additional mainland-China reachability deduction is applied.

Convention9 / 15 · 3.0/5

The documentation includes front matter, layered sections, examples, routing boundaries, dependency guidance, known pitfalls, benchmark material, and a skill card; the skill declares Apache-2.0 and the repository supplies license text. Points are deducted because versioning, changelog, maintenance ownership, and update path are incomplete; the benchmark reports an author-format issue, and repository license metadata is NOASSERTION.

Effectiveness6 / 15 · 2.0/5

The skill gives actionable paths, configuration snippets, and commands for new recipes, _target_ usage, validation, and checkpointing; BENCHMARK.md reports 95% Codex correctness and 93% Codex effectiveness across three positive tasks. Points are deducted because coverage is only three positive tasks with no negative cases, and no independently verifiable representative outputs or real project results are included; static calibration limits the score to 7 or less.

Verifiability4 / 10 · 2.0/5

Revision-pinned source material, evaluation tasks, expected behaviors, and a benchmark report provide some auditability. Points are deducted because evaluation coverage is narrow, no independently rerunnable test suite for this skill is included, and the benchmark results cannot be verified during this static review; static calibration limits the score to 5 or less.

Evidence confidence:Low Reviewed Jul 20, 2026 Reviewed revision 55f18499943e
The upstream repository has new commits since this review. The score still applies to the reviewed revision shown and may not cover the latest changes.
Before you use it
  • Before use, verify the current NeMo AutoModel version, actual module paths, and CLI behavior; examples may drift from upstream.
  • Do not treat the guidance as a validated training configuration; confirm data, model, checkpoint paths, resource costs, and overwrite risks before execution.
  • Add negative-trigger evaluations, rerunnable skill-specific tests, a compatibility matrix, named maintenance ownership, and a changelog.
See the full review method →

What does this skill do, and when should you use it?

This skill supports development of NeMo AutoModel training, fine-tuning, and evaluation recipes. It explains YAML structure, `_target_` callables, component builders, CLI routing, and execution flow. Coverage includes concrete recipe guidance for LLMs, VLMs, diffusion, and retrieval. It also specifies key settings for validation, checkpointing, resume, and local testing.

Guides an agent to locate recipe files and YAML sections under nemo_automodel/recipes/, identify builders for the model, optimizer, dataloaders, loss, schedulers, and checkpointing, and explain how _target_ invokes a fully qualified Python callable with keyword arguments. It provides minimal YAML and CLI override examples, including automodel finetune llm -c <config.yaml>, and helps check validation cadence, checkpoint cadence, restore paths, batch-size arithmetic, CLI route registration, and dataset-collator/model-shape mismatches.

  1. A NeMo AutoModel developer is adding an LLM fine-tuning or pretraining recipe variant and needs the relevant file, builders, CLI route, example YAML, and test path.
  2. A training engineer is adding YAML fields for an optimizer, dataset, or scheduler and needs to understand `_target_` and nested CLI overrides.
  3. A model engineer is configuring validation data, validation intervals, checkpoint intervals, or resume-from-checkpoint behavior.
  4. A troubleshooter is investigating a first-step crash, forward shape mismatch, validation OOM, or checkpoint restore failure within a recipe.
  5. A test author needs a small CPU-compatible unit test for a new recipe.

What are this skill's strengths and limitations?

Pros
  • Covers recipe YAML, builders, CLI routes, execution flow, training-loop details, validation, and checkpoint configuration.
  • Includes concrete configuration structures, commands, execution ordering, and common failure modes.
  • Defines a clear boundary around recipe construction and execution-flow questions.
Limitations
  • It is focused on recipe development and does not cover standalone cluster launchers or distributed-strategy selection.
  • The provided material does not enumerate this skill's own test files, platform matrix, or version compatibility range.
  • Examples depend on the corresponding NeMo AutoModel repository and `automodel` environment being available.

How do you install this skill?

Install the specific skill with the command documented in the repository README: npx skills add nvidia/skills --skill nemo-automodel-recipe-development --yes. Add --agent codex to target Codex. The provided source does not specify other installation methods or version requirements.

How do you use this skill?

After installation, ask the agent about a recipe task, for example: Create a new NeMo AutoModel LLM fine-tuning recipe variant and identify the YAML, builder functions, CLI route, and CPU validation command. A recipe can be launched with automodel finetune llm -c config.yaml, with nested overrides such as --optimizer.lr and --step_scheduler.max_steps.

FAQ

Will this skill automatically edit repository files?
The source presents it as recipe-development guidance and does not state that it automatically edits files; editing depends on the host agent and the user's request.
Does using it require a GPU or cluster?
The instructions cover distributed-training settings and also require a tiny CPU-compatible test, but they do not claim that complete recipes can train on CPU.
How should checkpoint resume be configured?
Set `restore_from.path` to the checkpoint directory and ensure the model architecture matches the checkpoint. The skill recommends consolidated safetensors as the default format.

More skills from this repository

All from NVIDIA/skills

Dev & Engineering ✓ NVIDIA · Official

NeMo AutoModel Distributed Training

Choose and configure multi-GPU and multi-node training strategies for NeMo AutoModel.

Automation & Ops ✓ NVIDIA · Official

NeMo AutoModel Launcher Configuration

Configure NeMo AutoModel launches across local, Slurm, and cloud runs.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge GPU Memory Tuning

Diagnose GPU OOMs in Megatron Bridge training and reduce fragmentation, activation, and PEFT memory usage.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge Training Resiliency

Configure fault recovery and hang detection for Megatron Bridge distributed training.

Dev & Engineering ✓ NVIDIA · Official

Megatron FSDP Configuration and Performance Guide

Enable, troubleshoot, and verify Megatron FSDP in Megatron-Bridge.

Dev & Engineering ✓ NVIDIA · Official

DALI Dynamic Mode Assistant

Helps agents write, review, and migrate NVIDIA DALI imperative dynamic-mode code.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge Recipe Recommender

Recommends adjustable Megatron Bridge recipes for your model, GPU budget, and training goal.

Dev & Engineering ✓ NVIDIA · Official

Jetson Target Switcher

Switch the active Jetson target among existing platform profiles.

Dev & Engineering ✓ NVIDIA · Official

NeMo AutoModel Model Onboarding

A structured guide for adding new LLM, MoE, and VLM architectures to NeMo AutoModel.

Dev & Engineering ✓ NVIDIA · Official

Megatron Bridge Activation Recompute

Trade extra compute for lower GPU activation memory in Megatron Bridge training.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge Parallelism Strategy Guide

Choose, combine, and validate Megatron Bridge parallelism configurations.

Dev & Engineering ✓ NVIDIA · Official

Jetson Target Platform Initializer

Create a Jetson target-platform profile for a reference devkit or custom carrier and update the active pointer.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge MoE Expert-Parallel Overlap

Configure, validate, and troubleshoot MoE expert-parallel communication overlap in Megatron-Bridge.

Automation & Ops ✓ NVIDIA · Official

Megatron-LM on SLURM

Launch, monitor, and troubleshoot multi-node Megatron-LM training on SLURM GPU clusters.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge CPU Offload

Configure, validate, and troubleshoot CPU offloading in Megatron Bridge to relieve GPU memory pressure.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge CUDA Graphs

Configure, validate, and benchmark CUDA Graph capture in Megatron Bridge to reduce host-driver overhead.

Dev & Engineering ✓ NVIDIA · Official

Megatron-Bridge Communication Overlap Guide

Configure and verify TP, DP, and PP communication overlap in Megatron-Bridge training.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge MoE Performance Workflow

Systematically diagnose and improve MoE training throughput in Megatron Bridge.

Automation & Ops ✓ NVIDIA · Official

TAO Jobs on Kubernetes

Submit and monitor NVIDIA TAO GPU training jobs through Kubernetes.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge Hierarchical Context Parallelism

Enable, troubleshoot, and verify hierarchical context parallelism in Megatron-Bridge.

Related skills