Dev & Engineering ✓ NVIDIA · Official nemo-relayplugin-developmentconfiguration-validationrollbackruntime-registrationjson-schema

NeMo Relay Plugin Builder

Guides reusable NeMo Relay runtime behavior into configurable plugins.

FollowSkills review · FSRS-2.0
Use with care
60/ 100 5-point scale 3.0 / 5
Trust20 / 25 · 4.0/5

The skill specifies least-privilege-oriented JSON-compatible configuration, avoidance of credentials and raw production payloads, side-effect-free validation, PluginContext ownership, and rollback on partial failure. It does not define user confirmation, concrete permission boundaries, detailed data flows, or operational rollback procedures, so 5 points are deducted.

Reliability9 / 20 · 2.3/5

The validation, diagnostics, registration, and partial-failure workflow is internally coherent, and a benchmark report is included. However, there are no committed tests for this skill's key paths, dependency versions, reproducible implementation details, or substantial abnormal-input and error-message examples, so 11 points are deducted.

Adaptability11 / 15 · 3.7/5

Audience, use cases, non-use cases, runtime surfaces, and language bindings are relatively clear, supporting accurate triggering. Chinese-language support, environment compatibility, and deeper non-fit boundaries are not documented, so 4 points are deducted.

Convention9 / 15 · 3.0/5

The main skill document is well layered and covers configuration, bindings, failure modes, and a checklist. The skill card supplies Apache 2.0, ownership, version, and evaluation metadata, but recommended Instructions and Examples sections are missing; the author format is flagged, maintenance responsibility, changelog, and update path are incomplete, and the supplied license metadata is NOASSERTION, so 6 points are deducted.

Effectiveness7 / 15 · 2.3/5

The material directly addresses configuration shape, deterministic validation, PluginContext registration, disabled-component validation, and rollback, which is enough to guide the core design statically. It lacks directly usable generated code, verified representative outputs, and quantified comparison with alternatives; the static cap therefore limits the score to 7.

Verifiability4 / 10 · 2.0/5

A pinned revision, evaluation tasks, metrics, and results provide limited auditability. The evaluation material is not independently reproducible evidence for the skill's key paths, and committed tests plus corroborating sources are absent, so 6 points are deducted.

Evidence confidence:Low Reviewed Jul 20, 2026 Reviewed revision 55f18499943e
The upstream repository has new commits since this review. The score still applies to the reviewed revision shown and may not cover the latest changes.
Before you use it
  • The benchmark report is static claimed evidence and does not replace independent execution of key plugin paths; add real tests, dependency versions, and rollback-failure tests.
  • The documentation lacks complete per-binding code examples, compatibility ranges, Chinese-language guidance, and operational rollback procedures.
  • Before publication, reconcile the NOASSERTION license metadata with the Apache-2.0 declaration and identify maintainers and the update channel.
See the full review method →

What does this skill do, and when should you use it?

This skill guides developers in packaging reusable, process-level NeMo Relay behavior behind shared configuration. It emphasizes stable plugin kinds, JSON-compatible configuration, deterministic side-effect-free validation, and rollback-safe registration through PluginContext. It covers runtime surfaces such as subscribers, guardrails, request intercepts, and execution intercepts. It is intended for behavior reused across applications, teams, or startup paths, not one-off request logic or configuration that depends on live runtime objects.

It guides the agent to decide whether a plugin is needed, select an initial runtime surface, design a snake_case configuration shape, and define stable diagnostics. It requires validation before initialization, stopping registration when errors are found, registering behavior through PluginContext, and testing activation, disabled components, validation failures, and rollback after partial registration failure. For dynamic plugins requiring structured CLI editing, it also directs authors to declare the config_schema capability and reference a local Draft 7 or Draft 2020-12 JSON Schema file. The skill itself does not provide a concrete plugin implementation or execute these operations automatically.

  1. A NeMo Relay developer needs to package subscribers or guardrails for reuse across multiple applications.
  2. A platform team needs to validate operator-supplied shared plugin configuration before changing runtime behavior.
  3. An engineering team needs configuration-based enablement, disablement, or staged rollout for request or execution intercepts.
  4. A plugin author needs to ensure failed registration does not leave partially activated runtime behavior.

What are this skill's strengths and limitations?

Pros
  • Covers plugin boundaries, configuration design, validation, registration, testing, rollback, and documentation.
  • Clearly separates side-effect-free validation from runtime registration.
  • Addresses JSON configuration compatibility across Rust, Python, Node.js, files, tests, and deployment systems.
  • Includes concrete guidance for config_schema, disabled-component validation, and sensitive-data handling.
Limitations
  • It is a design and implementation guide, not a runnable plugin, script, or test suite.
  • It does not specify a NeMo Relay version, build tool, runtime command, or platform matrix.
  • Implementers must define the plugin kind, fields, diagnostic format, and runtime behavior themselves.
  • The plugin approach is unsuitable for one-off request or tenant behavior and configurations containing clients, credentials, or framework objects.

How do you install this skill?

Install the specific skill with the skills CLI described in the repository README:

npx skills add nvidia/skills --skill nemo-relay-plugin-build --yes

You may target Codex explicitly:

npx skills add nvidia/skills --skill nemo-relay-plugin-build --agent codex --yes

The README does not document additional manual installation steps for this individual skill.

How do you use this skill?

After installation, invoke the skill when building configurable NeMo Relay plugins. For example: “Design and validate a NeMo Relay plugin for reusable request interception, register it through PluginContext, and ensure failed activation rolls back cleanly.” The specific plugin code, build commands, and runtime environment setup are not provided.

How does this skill compare with similar options?

For one-off or tenant-local behavior, the skill points to scope-local middleware. For direct tool or LLM call instrumentation, it points to nemo-relay-instrument-calls. For choosing an exporter path without packaging a plugin, it points to nemo-relay-plugin-observability.

FAQ

Does this skill automatically create or publish a plugin?
No. It provides guidance for design, validation, registration, testing, and documentation; concrete implementation and publishing steps are not specified.
Can plugin configuration contain clients or credentials?
It should not. The skill explicitly excludes callables, clients, credentials, file handles, framework objects, and caches from plugin configuration.
What should happen when validation fails?
The plugin should return structured error diagnostics and stop initialization and registration. Validation must not open network connections, create clients, or mutate process state.
When should this skill not be used?
Do not use the plugin approach for single-request or tenant-local behavior, direct call instrumentation, exporter selection, or configuration that depends on live runtime objects.

More skills from this repository

All from NVIDIA/skills

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Quick Start

Helps first-time NeMo Relay users prove observable execution value through the smallest suitable trial.

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Migration Assistant

Safely migrate NeMo Flow projects to NeMo Relay.

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Adaptive Tuning

Tune NeMo Relay plugin behavior from runtime signals with measured, reversible rollouts.

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Runtime Integration Debugger

Diagnose application-side runtime failures after NeMo Relay is installed or imported.

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Typed Wrappers & Codecs

Add typed boundaries to NeMo Relay integrations while preserving predictable JSON middleware semantics and caller-visible behavior.

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Installation Guide

Choose and verify the right NeMo Relay path for CLIs, language packages, and maintained frameworks.

Automation & Ops ✓ NVIDIA · Official

NeMo Relay Observability Plugin

Configure NeMo Relay event capture and telemetry exports.

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Call Instrumentation

Wrap tool and LLM calls with Relay lifecycle events, middleware, and guardrails.

Dev & Engineering ✓ NVIDIA · Official

NeMo Relay Context Isolation

Keeps NeMo Relay scope stacks independent across concurrent requests and async workflows while preserving ancestry propagation.

Automation & Ops ✓ NVIDIA · Official

DOCA Hardware Safety

A rollback-oriented operating discipline for live DPU and NIC hardware changes.

Automation & Ops ✓ NVIDIA · Official

DOCA Upgrade Control

Safely gate DOCA upgrades and rollbacks with explicit confirmation.

Dev & Engineering ✓ NVIDIA · Official

NeMo AutoModel Recipe Development

Build, modify, and validate NeMo AutoModel training and evaluation recipes.

Data & Analysis ✓ NVIDIA · Official

TAO DAFT Dataset Validator

Validate TAO DAFT dataset structure, schemas, and cross-references with tao-daft validate.

Automation & Ops ✓ NVIDIA · Official

DOCA Telemetry Utils

Discover telemetry counters, translate Data IDs, and verify BlueField support before committing exporter configuration.

Automation & Ops ✓ NVIDIA · Official

DOCA Structured Tools Contract

A governed fallback contract for consolidating DOCA environment, device, capability, validation, and host-DPU state data.

Automation & Ops ✓ NVIDIA · Official

Nemotron Safety Policy Generator

Generate deployable custom safety policies for NVIDIA Nemotron content-safety models.

Automation & Ops ✓ NVIDIA · Official

VSS Standalone Behavior Analytics

Deploy and operate VSS behavior analytics independently without bringing up the full warehouse stack.

Dev & Engineering ✓ NVIDIA · Official

NVIDIA cuOpt Developer

Guides source-level cuOpt modification, builds, tests, debugging, and contributions.

Data & Analysis ✓ NVIDIA · Official

DICOM Series Preflight

Header-only validation for one DICOM series before conversion or inference.

Dev & Engineering ✓ NVIDIA · Official

Jetson Target Switcher

Switch the active Jetson target among existing platform profiles.

Related skills