Dev & Engineering ✓ NVIDIA · Official nemo-relayruntime-debuggingscope-isolationnative-extensionsmiddlewareopentelemetry

NeMo Relay Runtime Integration Debugger

Diagnose application-side runtime failures after NeMo Relay is installed or imported.

FollowSkills review · FSRS-2.0
Not recommended
56/ 100 5-point scale 2.8 / 5
Trust17 / 25 · 3.4/5

The skill is scoped to NeMo Relay runtime-integration diagnosis and does not request credentials or broad access. The skill card explicitly prohibits secrets in prompts, logs, and output and recommends least-privilege credentials. However, uv sync, native rebuilds, loader-path changes, and exporter configuration can affect the environment or external systems; user confirmation, rollback, data-flow disclosure, and detailed safety boundaries are incomplete, so points are deducted.

Reliability9 / 20 · 2.3/5

The failure classes and troubleshooting matrix are internally coherent and cover Python, Node, Go, Rust, scopes, concurrency, plugins, and exporters, with several diagnostic checks. Concrete commands, version prerequisites, abnormal-input handling, and clear post-failure branches are missing. This is a static review without committed tests covering this skill's key paths, so the score remains below the static ceiling.

Adaptability11 / 15 · 3.7/5

The audience and activation scenarios are clear, covering load failures, scopes, events, plugins, adaptive behavior, and API-layer selection. Non-fit boundaries, input/output contracts, exclusion triggers, and Chinese-language support are not specified. Mainland-China reachability is not evidenced, although the core function is not stated to depend entirely on overseas services, so points are deducted.

Convention9 / 15 · 3.0/5

The SKILL.md is concise and layered, with metadata, first checks, failure classes, a troubleshooting matrix, and related skills; the skill card adds license, dependency, and risk notes. The static report explicitly identifies missing Instructions and Examples sections. Version policy, changelog, maintenance ownership, and update path are unclear, and the author format also fails the reported schema check, so points are deducted.

Effectiveness6 / 15 · 2.0/5

The matrix directly addresses the three positive evaluation cases: Python native-extension import failure, missing Node lifecycle events, and Go cross-request scope leakage. The committed evaluation report shows strong results on the positive tasks and includes a negative-routing task. However, the guidance is mostly directional, lacks copy-ready commands, platform/version branches, and complete validation outputs; the report cannot substitute for static reproduction, so the score is conservatively capped and reduced.

Verifiability4 / 10 · 2.0/5

SKILL.md, the evaluation report, and evals.json provide auditable failure mappings, expected behaviors, and limited evaluation evidence, while the report discloses static-validation findings. The evaluation has only four tasks with one attempt each and provides no independently reproducible logs, committed tests for this skill, or cross-source corroboration; confidence therefore remains low and the score stays below the static ceiling.

Evidence confidence:Low Reviewed Jul 20, 2026 Reviewed revision 55f18499943e
Before you use it
  • Before running uv sync, rebuilding native extensions, changing dynamic-loader paths, or modifying exporter configuration, confirm scope, permissions, and rollback options.
  • The matrix lacks concrete version requirements, command arguments, and failure branches; validate against the deployed NeMo Relay version and platform documentation rather than treating it as a verified fix.
  • Non-fit scenarios, Chinese-language behavior, and mainland-China network reachability are not explicitly defined.
See the full review method →

What does this skill do, and when should you use it?

This skill targets applications where NeMo Relay is present but runtime behavior is missing or incorrect. It directs the agent to identify the failing runtime layer before changing configuration. Coverage includes native artifact loading, scope stacks, event registration, subscribers and exporters, plugins, adaptive components, provider payload conversion, and OpenTelemetry or OpenInference export. It is useful for integration troubleshooting, but it is not a complete installation guide or an automated repair tool.

Guides checks for Python, Node.js, and Go native components; verifies active scopes and scope stacks; reviews subscriber, exporter, middleware, plugin, and adaptive configuration; and checks registration timing, concurrency boundaries, lifecycle calls, and provider-object conversion. It also provides troubleshooting actions for Rust builds, Python environment reconstruction, Node native-addon rebuilds, Go FFI loader paths, ATIF output, OpenTelemetry/OpenInference exporters, and independent plugin validation.

  1. A developer whose Python application cannot import the NeMo Relay native extension.
  2. A developer debugging a Node.js native addon that was not built or will not load.
  3. A developer whose execution occurs outside an active scope or crosses a thread, task, goroutine, or worker boundary incorrectly.
  4. A developer investigating missing subscriber events, empty ATIF output, or mixed data from concurrent agents.
  5. A developer whose plugin or adaptive configuration appears enabled but does not change runtime behavior.

What are this skill's strengths and limitations?

Pros
  • Uses a runtime-layer-first diagnostic approach across multiple language bindings and integration paths.
  • Covers concrete checks for scope isolation, event registration, concurrency, plugins, adaptive behavior, and exporters.
  • Distinguishes managed execute, manual lifecycle, typed-wrapper, and adaptive/plugin API layers.
Limitations
  • Provides no runnable diagnostic script or complete repair implementation.
  • Provides no binding-version compatibility matrix or verified platform list.
  • Several recommendations depend on the application's build system and runtime environment, so the user must perform and interpret the checks.

How do you install this skill?

Install the individual skill from NVIDIA's collection with the default skills CLI:

npx skills add nvidia/skills --skill nemo-relay-debug-runtime-integration --yes

You can also browse the catalog with npx skills add nvidia/skills --list. The README does not specify additional installation dependencies or version requirements for this skill.

How do you use this skill?

Place the installed skill where the agent can load it, then invoke it for a NeMo Relay runtime integration problem, for example: "Debug a NeMo Relay integration that produces no lifecycle events, starting by identifying the failing runtime layer." The application code, binding versions, and platform configuration must be supplied by the user; SKILL.md defines no dedicated command or automation script.

FAQ

What problems does this skill address?
It addresses installed or imported NeMo Relay integrations with load failures, inactive scopes, missing events, ineffective plugins or adaptive behavior, and export failures.
Does it automatically repair the application?
No. It supplies layered diagnostic guidance and troubleshooting actions, not an automated repair script.
What tools may be required?
Depending on the failure, Rust, Python, uv, Node.js, or Go may be needed to build and inspect the relevant components; no fixed versions are specified.
Does it require networking or MCP?
It discusses OpenTelemetry/OpenInference endpoints, headers, HTTP versus gRPC, and exporter runtime conditions, but it declares no MCP requirement and does not provide full network deployment instructions.

More skills from this repository

All from NVIDIA/skills

Automation & Ops ✓ NVIDIA · Official

NeMo Relay Observability Plugin

Configure NeMo Relay event capture and telemetry exports.

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Call Instrumentation

Wrap tool and LLM calls with Relay lifecycle events, middleware, and guardrails.

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Typed Wrappers & Codecs

Add typed boundaries to NeMo Relay integrations while preserving predictable JSON middleware semantics and caller-visible behavior.

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Context Isolation

Keeps NeMo Relay scope stacks independent across concurrent requests and async workflows while preserving ancestry propagation.

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Plugin Builder

Guides reusable NeMo Relay runtime behavior into configurable plugins.

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Adaptive Tuning

Tune NeMo Relay plugin behavior from runtime signals with measured, reversible rollouts.

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Installation Guide

Choose and verify the right NeMo Relay path for CLIs, language packages, and maintained frameworks.

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Quick Start

Helps first-time NeMo Relay users prove observable execution value through the smallest suitable trial.

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Migration Assistant

Safely migrate NeMo Flow projects to NeMo Relay.

Dev & Engineering ✓ NVIDIA · Official

DOCA Debug

A cross-library diagnostic guide for NVIDIA DOCA build, link, runtime, and program failures.

Dev & Engineering ✓ NVIDIA · Official

NeMo AutoModel Model Onboarding

A structured guide for adding new LLM, MoE, and VLM architectures to NeMo AutoModel.

Dev & Engineering ✓ NVIDIA · Official

NeMo AutoModel Distributed Training

Choose and configure multi-GPU and multi-node training strategies for NeMo AutoModel.

Dev & Engineering ✓ NVIDIA · Official

NeMo Evaluator Plugin Skill

Run and manage NeMo Platform model evaluations through the Evaluator CLI and Python SDK.

Writing & Content ✓ NVIDIA · Official

NeMo-RL Documentation Conventions

Keeps NeMo-RL documentation, indexes, and docstrings consistent.

Dev & Engineering ✓ NVIDIA · Official

DOCA RDMA Initiator

Guides accelerator-initiated one-sided RDMA development on the DPA datapath.

Data & Analysis ✓ NVIDIA · Official

Nemotron Speech ASR Customization Orchestrator

Chooses and coordinates the lowest-cost path for adapting speech recognition to a domain or language.

Data & Analysis ✓ NVIDIA · Official

Clinical ASR Evaluation and KER Leaderboard

Evaluate clinical ASR manifests and isolate terminology-recognition failures.

Dev & Engineering ✓ NVIDIA · Official

NeMo AutoModel Recipe Development

Build, modify, and validate NeMo AutoModel training and evaluation recipes.

Automation & Ops ✓ NVIDIA · Official

AutoMagicCalib Calibration Stack Launcher

Deploy the AutoMagicCalib microservice and web UI with Docker Compose for a ready-to-use camera calibration stack.

Automation & Ops ✓ NVIDIA · Official

NeMo-RL Kubernetes Launcher

Launch, monitor, iterate on, and debug NeMo-RL training runs on Kubernetes.

Related skills