Nemotron Speech NIM Skill
Guides deployment and operation of NVIDIA Riva ASR, TTS, and translation NIMs.
The skill explicitly prohibits exposing NVIDIA_API_KEY and NGC_API_KEY, recommends non-printing secret checks, and discloses that Docker environment variables may appear in inspect output or process listings. It also routes users to canonical NVIDIA documentation and identifies some permission risks. Points are deducted because the workflow still relies broadly on sudo, Docker, external networks, and remote APIs without a consistently enforced confirmation gate, rollback plan, complete data-flow boundaries, or comprehensive dependency-security guidance; repository license metadata is NOASSERTION while the file claims Apache-2.0.
The documentation provides clear routing, deployment phases, readiness checks, audio validation, and several diagnosable failure messages, while directing release-sensitive values to current NVIDIA documentation. Points are deducted because this review is static and cannot reproduce key paths; cloud functions, container tags, client scripts, and referenced files depend on external state, and command/version compatibility assumptions were not executed or verified. The score therefore stays below the static ceiling of 10.
The audience, ASR/TTS/NMT scenarios, cloud versus self-hosted paths, trigger terms, non-fit ranges, and x86_64/WSL2 limitations are described, and the evaluation material specifies several negative-trigger cases. Points are deducted because generic terms such as Whisper can still cause false activation; Chinese-language support and reachability from mainland-China networks are not substantively demonstrated, while the cloud path depends on build.nvidia.com, NVCF, and GitHub services that may be difficult to reach.
The skill uses a top-level routing surface with progressive disclosure through reference files and includes a version, team metadata, tags, examples, troubleshooting, limitations, and an update path through official documentation. Points are deducted for the absence of a clearly named maintainer, changelog, pinned dependency versions, and complete installation governance; the supplied benchmark also reports documentation-quality issues involving script tables, run_script guidance, and reference organization, while repository license metadata remains unclear.
The material covers model selection, environment checks, deployment, readiness verification, inference, and custom-model conversion, with commands that are often directly adaptable and reduce manual discovery work. Points are deducted because model names, function IDs, container tags, VRAM requirements, and feature support must be re-queried, and no representative outputs were executed or independently verified in this review. Users still bear external-service, credential, GPU, and release-compatibility costs, so the score remains near the static ceiling.
The skill provides many official NVIDIA documentation, API, NGC, and GitHub reference points, plus evaluation data, test tasks, and expected behaviors that offer useful audit trails. Points are deducted because the benchmark and percentages are claims contained in the supplied files, not independently reproducible CI evidence or third-party results; no commands were executed and no cross-source verification was performed. The score therefore stays below the static ceiling of 5.
- Cloud inference depends on NVIDIA NVCF/build.nvidia.com, external connectivity, and valid credentials; mainland-China reachability and latency were not verified.
- Do not treat model names, function IDs, container tags, VRAM values, or feature support in the files as current facts; recheck them for the target release.
- Passing credentials through Docker environment variables may expose them through inspect or process information; use Docker secrets or a dedicated secret manager.
- No commands or outputs were executed in this review, so the supplied PASS verdict and percentages do not replace independent reproduction.
What does this skill do, and when should you use it?
Nemotron Speech is a single entry point for NVIDIA Nemotron Speech, publicly documented as Riva or Riva NIM, covering ASR, TTS, and NMT. It supports cloud inference through build.nvidia.com and self-hosted Docker deployment on NVIDIA GPUs. The skill routes requests to workflow references for setup, model selection, deployment checks, inference, custom ASR conversion, and pipeline tuning. Self-hosting requires NVIDIA AI Enterprise, while cloud inference requires an NVIDIA_API_KEY and internet access.
Routes requests to setup, deployment-readiness, model-selection, ASR, custom-ASR, pipeline, TTS, or NMT reference files; guides installation of NVIDIA drivers, Docker, Container Toolkit, and the Riva Python client; explains deployment and invocation through build.nvidia.com or self-hosted Docker; covers gRPC, HTTP, and WebSocket ASR protocols plus VAD, diarization, language-model, and chunk-size configuration; guides conversion of NeMo .nemo models to RMIR and deployment with riva-build; and documents API-key handling and NIM cache-directory permissions.
- An engineer deploying Parakeet, Canary, Whisper, or Nemotron ASR Streaming on NVIDIA GPUs.
- A developer calling Magpie TTS through build.nvidia.com.
- A team deploying Riva Translate with language-pair or DNT-tag requirements.
- A developer converting a fine-tuned NeMo `.nemo` ASR model into RMIR and a NIM.
- An operator checking GPU compatibility, container health, and deployment readiness.
What are this skill's strengths and limitations?
- Covers ASR, TTS, NMT, and custom ASR deployment.
- Supports both build.nvidia.com cloud inference and self-hosted Docker deployment on NVIDIA GPUs.
- Includes gRPC, HTTP, and WebSocket choices for ASR clients.
- Provides operational guidance for GPU compatibility, container health, and cache permissions.
- Self-hosting requires NVIDIA AI Enterprise entitlement.
- Cloud inference requires a valid NVIDIA_API_KEY and internet access.
- The documented architecture is x86_64; Windows WSL2 requires Podman and supports only a subset of NIMs.
- SKILL.md is a routing surface, so current model catalogs, container IDs, VRAM requirements, and feature support must be checked in NVIDIA documentation; the referenced workflow files are not included in the supplied source.
How do you install this skill?
Install the specific skill with the NVIDIA skills CLI: npx skills add nvidia/skills --skill nemotron-speech --yes. The README says the CLI installs the skill for a selected agent target; use options such as --agent codex or --agent claude-code when needed.
How do you use this skill?
After installation, ask for a relevant task in natural language, such as “Deploy a Parakeet ASR NIM” or “Synthesize speech with Magpie.” The skill identifies the task and loads the corresponding workflow reference. Cloud inference requires nvidia-riva-client and a valid NVIDIA_API_KEY; self-hosted workflows require drivers, Docker, Container Toolkit, an NGC API key, and the Riva client.
How does this skill compare with similar options?
Cloud mode is suited to quick inference through build.nvidia.com without local deployment. Self-hosting is suited to running on owned NVIDIA GPUs but requires NVIDIA AI Enterprise, drivers, Docker, Container Toolkit, and NGC configuration.