Dev & Engineering ✓ NVIDIA · Official doca-benchshared-librarymesoncudagpunetiolinuxbenchmarking

DOCA Bench Extension Builder

Build, load, smoke-test, and debug custom doca-bench plug-ins for workloads beyond built-in modes.

FollowSkills review · FSRS-2.0
Not recommended
47/ 100 5-point scale 2.4 / 5
Trust13 / 25 · 2.6/5

The documentation requires prerequisite checks, smoke-before-scale execution, log capture before retries, and disclosure of crash, hang, and dataplane risks from loading custom code into the parent process and device environment. It lacks execution isolation, fully explicit user-authorization boundaries, and a complete rollback/recovery procedure, so points are deducted from the midrange.

Reliability9 / 20 · 2.3/5

SKILL.md, CAPABILITIES.md, and TASKS.md provide a substantial configure/build/run/test/debug workflow and require intelligible, verbatim failure feedback. However, the key runtime discovery mechanism depends on external documentation and the local installation; nothing was executed, and static calibration caps the score at 10.

Adaptability9 / 15 · 3.0/5

The intended audience, trigger phrases, non-fit cases, companion skills, and Linux/DOCA/hardware prerequisites are clearly described. The skill is aimed at advanced Meson, shared-library, CUDA, and GPUNetIO users, contains no Chinese-language guidance, and depends partly on docs.nvidia.com, which may be difficult to reach from mainland China, so points are deducted.

Convention7 / 15 · 2.3/5

The material is layered across capabilities, tasks, error taxonomy, and safety policy, with examples, dependencies, and rebuild/version rules. Versioning, authorship, maintenance ownership, and change history are incomplete; BENCHMARK.md also records missing recommended Instructions/Examples and author metadata. License declarations are inconsistent with the prompt's NOASSERTION metadata and the SKILLCARD contents, so points are deducted.

Effectiveness6 / 15 · 2.0/5

The skill offers directly useful guidance for extension selection, reference adaptation, SONAME checking, smoke testing, and layered debugging. Its runtime discovery recipe is intentionally incomplete and requires local installation details plus external documentation, leaving substantial environment-specific validation to the user; the static score is therefore kept below the allowed maximum.

Verifiability3 / 10 · 1.5/5

The files contain auditable workflow descriptions, symbol shapes, paths, and a claimed evaluation report. They do not include a committed test suite covering the key paths or independently reproducible third-party execution evidence, so the reported evaluation cannot fully substantiate the claims and verifiability remains limited.

Evidence confidence:Low Reviewed Jul 29, 2026 Reviewed revision ce70ca7f1966
The upstream repository has new commits since this review. The score still applies to the reviewed revision shown and may not cover the latest changes.
Before you use it
  • Custom extensions run inside the doca-bench address space, and GPU kernels may hang and require an OOB reset; confirm isolation, co-tenancy impact, recovery authority, and user consent before execution.
  • Runtime discovery, exact API details, and some version behavior depend on the local DOCA installation and external NVIDIA documentation; they cannot be confirmed from this static skill alone.
  • License and provenance metadata are inconsistent: the prompt states NOASSERTION, while different files declare Apache-2.0 or Apache-2.0 AND CC-BY-4.0.
  • The skill is English-only, and reliance on external documentation may reduce reachability for mainland-China users.
Review evidence [1][2][3][4][5][6][7][8][9]
See the full review method →

What does this skill do, and when should you use it?

This skill serves platform and performance engineers whose workload is not covered by doca-bench's built-in modes. It guides the extension workflow from configuration through build, runtime loading, testing, and layered debugging. Extensions are versioned Linux shared libraries that expose DOCA_EXPERIMENTAL-marked C entry points and are invoked by the parent doca-bench tool. The shipped doca_bench_cuda implementation is the reference exemplar for GPU-side workloads, while DOCA GPUNetIO semantics and CUDA installation remain outside this skill's scope.

It helps the operator decide whether an extension is necessary, locate the reference tree at /opt/mellanox/doca/tools/bench_extension/doca_bench_cuda/, and follow its Meson build and API shape. It explains versioned shared-library packaging, workload settings structures, parent-tool invocation, and the cheapest smoke test before bulk benchmarking. It also separates build failures, loading failures, registration mismatches, and runtime call failures.

  1. A performance engineer needs to measure a workload class that no built-in doca-bench mode supports.
  2. A CUDA or GPUNetIO engineer wants to adapt the shipped doca_bench_cuda reference extension.
  3. A custom shared object builds successfully but doca-bench cannot find, load, or call it.
  4. An operator must diagnose a soversion or DOCA_EXPERIMENTAL compatibility problem after a DOCA upgrade.
  5. A team wants to verify extension discovery and returned data before running its production workload benchmark.

What are this skill's strengths and limitations?

Pros
  • Covers the custom-plugin lifecycle from extension-vs-built-in decisions through debugging.
  • Uses doca_bench_cuda as a concrete reference for API shape and build layout.
  • Keeps built-in benchmarking, GPUNetIO semantics, and CUDA installation in their proper companion resources.
  • Makes DOCA versioning, soversion matching, and experimental API stability explicit.
Limitations
  • It is not a replacement for the doca-bench built-in mode inventory and adds unnecessary cost when a built-in mode fits.
  • It assumes a Linux native-build environment with the DOCA SDK and compatible hardware; the GPU exemplar adds CUDA requirements.
  • The provided SKILL.md does not document every entry-point signature or the complete runtime discovery mechanism.
  • DOCA_EXPERIMENTAL APIs and release-matched soversion can require rebuilding after DOCA upgrades.

How do you install this skill?

Install the skill from the NVIDIA/skills collection with: npx skills add nvidia/skills --skill doca-bench-extension --yes. The repository README states that the skills CLI runs through npx and makes the skill available the next time the agent loads relevant skills. Running the extension also requires the DOCA SDK at /opt/mellanox/doca on Linux, a BlueField DPU or ConnectX NIC, and pkg-config doca-common; the GPU reference additionally requires an NVIDIA GPU and matching CUDA toolkit.

How do you use this skill?

In an Agent Skills-compatible client, use a prompt such as: “No built-in doca-bench mode fits my workload. How do I build and load a custom extension?” The skill's workflow first checks that DOCA and doca-bench are available, then confirms that no built-in mode applies, and proceeds through configure → build → run → test → debug. The exact runtime discovery mechanism must be taken from the installed doca-bench binary, the shipped extension's meson.build, and NVIDIA's public documentation; this SKILL.md deliberately does not invent it.

How does this skill compare with similar options?

Compared with doca-bench's built-in modes, this skill addresses the external extension path for workload classes those modes do not cover; built-in-mode selection remains the responsibility of the doca-bench skill.

FAQ

Can the extension run as a standalone benchmark tool?
No. It is a plug-in framework for shared libraries that the parent doca-bench process loads and invokes; it has no standalone CLI.
Is CUDA mandatory?
Not for every extension. CUDA is required for the shipped doca_bench_cuda GPU reference; other extension source languages depend on the workload.
Why may a DOCA upgrade require a rebuild?
The extension uses DOCA_EXPERIMENTAL entry points and its shared-library soversion must match the DOCA release, so rebuilding across upgrades is treated as the normal rule.

More skills from this repository

All from NVIDIA/skills

Dev & Engineering ✓ NVIDIA · Official

DOCA GPUNetIO WRITE Bandwidth Benchmark

Build, run, and interpret sustained RDMA WRITE bandwidth measurements driven by CUDA kernels through the DOCA GPUNetIO surface.

Dev & Engineering ✓ NVIDIA · Official

GPUNetIO RDMA Write Latency Benchmark

Guides reproducible measurement of CUDA-kernel-initiated GPUNetIO RDMA WRITE latency and tail behavior.

Dev & Engineering ✓ NVIDIA · Official

DOCA GPUNetIO Development Skill

Helps developers connect CUDA kernels on NVIDIA GPUs to DOCA network queues for GPU-side packet I/O and debugging.

Automation & Ops ✓ NVIDIA · Official

TAO NVIDIA GPU Host Setup

Checks and standardizes NVIDIA drivers, CUDA, and container runtime prerequisites for TAO GPU hosts.

Automation & Ops ✓ NVIDIA · Official

DOCA Bench Benchmarking Skill

Measure DOCA library throughput, latency, and bandwidth reproducibly on real NVIDIA networking hardware.

Dev & Engineering ✓ NVIDIA · Official

DOCA Programming Guide

Guides developers through building, testing, and debugging library-agnostic DOCA applications from shipped samples.

Dev & Engineering ✓ NVIDIA · Official

DOCA GPI GPU-Initiated RDMA Skill

Helps CUDA kernels drive RDMA queues directly from GPU memory without host-CPU mediation.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge GPU Memory Tuning

Diagnose GPU OOMs in Megatron Bridge training and reduce fragmentation, activation, and PEFT memory usage.

Data & Analysis ✓ NVIDIA · Official

NV-Segment-CT Medical Imaging Segmentation Skill

Run VISTA3D on CT NIfTI volumes and produce verifiable label-map evidence.

Data & Analysis ✓ NVIDIA · Official

NV-Segment-CT Fine-Tuning

Fine-tune NV-Segment-CT VISTA3D on labeled CT NIfTI datasets.

Dev & Engineering ✓ NVIDIA · Official

cuPyNumeric Migration Readiness

Assess whether NumPy code is ready to scale on GPUs before committing to a substantial cuPyNumeric port.

Data & Analysis ✓ NVIDIA · Official

NV-Generate-MR

Generate synthetic body MRI volumes through NVIDIA’s rflow-mr workflow.

Automation & Ops ✓ NVIDIA · Official

Jetson Package & Environment Advisor

Select Jetson-compatible containers and GPU package indexes by device architecture.

Data & Analysis ✓ NVIDIA · Official

NV-Generate-CT Synthetic CT Generator

Generate paired synthetic CT volumes and masks through NVIDIA’s rflow-ct pipeline.

Dev & Engineering ✓ NVIDIA · Official

Holoscan SDK Setup Guide

Inspects a Linux host and selects the most suitable Holoscan SDK installation path.

Dev & Engineering ✓ NVIDIA · Official

Jetson Fan Curve Customizer

Safely maintain nvfancontrol fan profiles and boot defaults in a Jetson BSP.

Dev & Engineering ✓ NVIDIA · Official

NVIDIA Skill Finder

Finds the right NVIDIA agent skill for product, hardware, and workflow requests.

Dev & Engineering ✓ NVIDIA · Official

Earth2Studio Deterministic Forecast

Build single-member weather forecast inference scripts with Earth2Studio.

Data & Analysis ✓ NVIDIA · Official

NV-Segment-CTMR Medical Image Segmentation

Run CT or MRI NIfTI segmentation and capture inspectable label-map evidence.

Dev & Engineering ✓ NVIDIA · Official

TileGym cuTile Kernel Guide

A step-by-step guide for registering, implementing, testing, and benchmarking a new cuTile GPU kernel in TileGym.

Related skills