Automation & Ops ✓ NVIDIA · Official nemo-automodelslurmskypilotdistributed-trainingtorchrunnsight-systems

NeMo AutoModel Launcher Configuration

Configure NeMo AutoModel launches across local, Slurm, and cloud runs.

FollowSkills review · FSRS-2.0
Not recommended
54/ 100 5-point scale 2.7 / 5
Trust16 / 25 · 3.2/5

The skill provides configuration guidance and command examples without apparent malware, credential theft, or destructive defaults; it references HF_TOKEN, WANDB_API_KEY, cloud submission, container mounts, and environment variables, and warns about spot preemption and profiling overhead. Deductions apply because it does not require execution-time confirmation or sufficiently disclose credential handling, permission scope, external effects, or rollback procedures.

Reliability8 / 20 · 2.0/5

The main interactive, Slurm, SkyPilot, and profiling paths are documented coherently with fields and common pitfalls. Deductions apply because prerequisites, version compatibility, failure diagnosis, and recovery are thin; the multi-node environment-variable statement mentions nodes times ntasks_per_node while the SkyPilot example does not define ntasks_per_node, creating possible ambiguity. Static calibration caps this at 10.

Adaptability11 / 15 · 3.7/5

The name, trigger conditions, three launch modes, and explicit routing boundary are clear, and launcher configuration is separated from model onboarding. Deductions apply because non-fit cases, input validation, and environment requirements are incomplete; Chinese-language support and mainland-China reachability are not established. Interactive and local Slurm use are not entirely dependent on overseas services.

Convention9 / 15 · 3.0/5

The SKILL.md has clear metadata, templates, field descriptions, examples, pitfalls, and code anchors; the skill card adds Apache 2.0 licensing, ownership, version information, and references. Deductions apply because Purpose, formal Examples, prerequisites, limitations, troubleshooting, changelog, and a clear maintenance/update path are missing; BENCHMARK.md records the same static-validation gaps.

Effectiveness6 / 15 · 2.0/5

The skill produces directly reusable YAML, bash, and runtime-behavior guidance, and its three evaluation tasks align closely with the documented content; the benchmark reports strong correctness and effectiveness. Deductions apply because evaluation covers only three positive scenarios with no negative-trigger cases, the report is not independently reproducible here, and real-environment correctness and runnability still require human validation. Static calibration caps this at 7.

Verifiability4 / 10 · 2.0/5

The fixed revision, evaluation tasks, ground truths, result summary, code anchors, and named references provide some auditability. Deductions apply because there are no raw execution logs, CI tests, or committed tests covering this skill's key paths; the benchmark is primarily a declarative summary and cannot be independently reproduced from the supplied files. Static calibration caps this at 5.

Evidence confidence:Low Reviewed Jul 20, 2026 Reviewed revision 55f18499943e
The upstream repository has new commits since this review. The score still applies to the reviewed revision shown and may not cover the latest changes.
Before you use it
  • Manually confirm permissions for Slurm, containers, mounts, cloud resources, and environment variables before execution; do not place real credentials in configuration or logs.
  • Add versions and prerequisites for NeMo AutoModel, torchrun, Slurm, SkyPilot, and Nsight Systems, together with failure diagnosis, recovery, and rollback guidance.
  • Reachability from mainland-China networks for cloud regions, image registries, and Hugging Face dependencies is unverified; spot preemption and checkpoint restoration may still interrupt jobs or lose work.
  • The benchmark covers only three positive tasks and supplies no raw execution evidence, so it cannot replace validation in the target environment.
See the full review method →

What does this skill do, and when should you use it?

This skill guides NeMo AutoModel launches on the current node, Slurm HPC clusters, and SkyPilot cloud environments. It covers torchrun, multi-node rendezvous, containers, mounts, environment variables, and Nsight Systems profiling. The launchers configure distributed runtime variables automatically for multi-node jobs. It is intended for launch YAML authoring and submission troubleshooting, not model onboarding or state-dict adapter implementation.

Generates or adjusts YAML for the requested launch mode; explains automodel and torchrun commands for interactive runs; configures Slurm job names, nodes, tasks per node, time limits, accounts, partitions, container images, mounts, cache paths, environment variables, and master_port; configures SkyPilot cloud, accelerators, node count, spot usage, disk size, region, and setup commands; explains WORLD_SIZE, MASTER_ADDR, MASTER_PORT, and NCCL environment variables; enables Slurm nsys profile and identifies the .nsys-rep output; provides checkpointing and restore guidance for spot preemption.

  1. A NeMo AutoModel developer needs a single-node development or debugging run using all local GPUs and wants an interactive torchrun launch.
  2. An HPC user needs to submit a multi-node training job and configure Slurm resources, containers, mounts, and distributed communication.
  3. A cloud user needs to submit a NeMo AutoModel job through SkyPilot on AWS, GCP, Azure, Lambda, or Kubernetes.
  4. A SkyPilot spot user wants to limit lost work after preemption by configuring short checkpoint intervals and restore_from.
  5. A Slurm user needs a short diagnostic profiling run that produces an Nsight Systems report.
  6. A job owner is troubleshooting port collisions, missing mount paths, environment-variable expansion, or insufficient wall time.

What are this skill's strengths and limitations?

Pros
  • Covers interactive, Slurm, and SkyPilot launch paths in one skill.
  • Identifies the important fields for multi-node communication, containers, mounts, and environment variables.
  • Includes practical warnings for port collisions, spot preemption, asynchronous checkpoints, and profiling overhead.
  • The skill metadata names NVIDIA as author and specifies Apache-2.0 licensing.
Limitations
  • Its scope stops at launch mechanics; it does not implement model architectures, Hugging Face state-dict adapters, or model files.
  • Successful Slurm and SkyPilot execution depends on the user's existing cluster, cloud account, and runtime environment.
  • The supplied material gives no independent test results, support matrix, or specific version compatibility information.
  • Nsight profiling adds overhead and creates large report artifacts, so it is unsuitable for normal production training.

How do you install this skill?

Install the specific skill through the skills CLI documented in the repository README:

npx skills add nvidia/skills --skill nemo-automodel-launcher-config --yes

To target Codex explicitly:

npx skills add nvidia/skills --skill nemo-automodel-launcher-config --agent codex --yes

The supplied material does not document a standalone package, version requirement, or exact manual-copy destination.

How do you use this skill?

After installation, ask for a concrete launch configuration, such as: “Generate a Slurm configuration for NeMo AutoModel with 2 nodes and 8 tasks per node” or “Configure a SkyPilot spot run with checkpoint recovery.” Interactive mode requires no extra YAML section; when neither slurm: nor skypilot: is present, the CLI routes to torchrun automatically. Include the relevant platform and profiling requirements in the request.

How does this skill compare with similar options?

Interactive launch is for development and debugging on the current node; Slurm is for HPC batch scheduling and multi-node execution; SkyPilot is for cloud-agnostic and spot-based jobs. These are the three launch alternatives explicitly covered by the skill.

FAQ

Does this skill run the training job itself?
The supplied instructions describe launch configuration and guidance; execution still occurs through automodel, torchrun, Slurm, or SkyPilot in the user's environment.
What fields are required for a Slurm launch?
The core fields are job_name, nodes, ntasks_per_node, time, and account or partition. Common supporting fields are container_image, hf_home, environment variables, and master_port.
How should a SkyPilot spot job recover from preemption?
Set use_spot: true, use a short step_scheduler.checkpoint_interval, and resume with restore_from.path.
What can cause submission failure?
The documented pitfalls include a master_port collision, an extra_mounts source missing on an allocated node, environment variables not using ${VAR} syntax, and a Slurm time limit that interrupts an asynchronous checkpoint write.

More skills from this repository

All from NVIDIA/skills

Dev & Engineering ✓ NVIDIA · Official

NeMo AutoModel Distributed Training

Choose and configure multi-GPU and multi-node training strategies for NeMo AutoModel.

Dev & Engineering ✓ NVIDIA · Official

NeMo AutoModel Recipe Development

Build, modify, and validate NeMo AutoModel training and evaluation recipes.

Automation & Ops ✓ NVIDIA · Official

Megatron-LM on SLURM

Launch, monitor, and troubleshoot multi-node Megatron-LM training on SLURM GPU clusters.

Automation & Ops ✓ NVIDIA · Official

NeMo MBridge Multi-Node Slurm

Convert single-node MBridge scripts into multi-node Slurm jobs and diagnose launch, NCCL, and MoE memory failures.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge GPU Memory Tuning

Diagnose GPU OOMs in Megatron Bridge training and reduce fragmentation, activation, and PEFT memory usage.

Dev & Engineering ✓ NVIDIA · Official

NeMo AutoModel Model Onboarding

A structured guide for adding new LLM, MoE, and VLM architectures to NeMo AutoModel.

Dev & Engineering ✓ NVIDIA · Official

Megatron Bridge Activation Recompute

Trade extra compute for lower GPU activation memory in Megatron Bridge training.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge Parallelism Strategy Guide

Choose, combine, and validate Megatron Bridge parallelism configurations.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge MoE Expert-Parallel Overlap

Configure, validate, and troubleshoot MoE expert-parallel communication overlap in Megatron-Bridge.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge Training Resiliency

Configure fault recovery and hang detection for Megatron Bridge distributed training.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge CPU Offload

Configure, validate, and troubleshoot CPU offloading in Megatron Bridge to relieve GPU memory pressure.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge CUDA Graphs

Configure, validate, and benchmark CUDA Graph capture in Megatron Bridge to reduce host-driver overhead.

Dev & Engineering ✓ NVIDIA · Official

TAO Platform Execution SDK

Submit, monitor, and manage NVIDIA TAO GPU training jobs across supported platforms.

Dev & Engineering ✓ NVIDIA · Official

Megatron FSDP Configuration and Performance Guide

Enable, troubleshoot, and verify Megatron FSDP in Megatron-Bridge.

Dev & Engineering ✓ NVIDIA · Official

Megatron-Bridge Communication Overlap Guide

Configure and verify TP, DP, and PP communication overlap in Megatron-Bridge training.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge MoE Performance Workflow

Systematically diagnose and improve MoE training throughput in Megatron Bridge.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge Recipe Recommender

Recommends adjustable Megatron Bridge recipes for your model, GPU budget, and training goal.

Automation & Ops ✓ NVIDIA · Official

TAO Jobs on Kubernetes

Submit and monitor NVIDIA TAO GPU training jobs through Kubernetes.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge Hierarchical Context Parallelism

Enable, troubleshoot, and verify hierarchical context parallelism in Megatron-Bridge.

Dev & Engineering ✓ NVIDIA · Official

DeepStream Pipeline Profiler

Measure DeepStream pipelines and derive performance-focused configurations.

Related skills