Automation & Ops ✓ NVIDIA · Official doca-benchrdmabluefieldconnectxmicrobenchmarkingthroughput-testinglatency-testingperformance-regression

DOCA Bench Benchmarking Skill

Measure DOCA library throughput, latency, and bandwidth reproducibly on real NVIDIA networking hardware.

FollowSkills review · FSRS-2.0
Not recommended
54/ 100 5-point scale 2.7 / 5
Trust16 / 25 · 3.2/5

The documentation defines a non-production warning, cautions about sensitive information on the companion-app channel, requires smoke-before-bulk execution, and forbids invented parameters. Deductions apply because least privilege, explicit user confirmation, rollback, and data-redaction procedures are not specified; requiring a full unredacted summary and CSV may expose sensitive environment details.

Reliability9 / 20 · 2.3/5

The configure, run, test, and layered-debug workflows are reasonably coherent and cover version, device, granular-build, warm-up, steady state, and failure routing. Deductions apply because no key path was executed in this static review, failure feedback depends on external documentation and installed --help, and TASKS.md inconsistently describes three modes while other files define four.

Adaptability11 / 15 · 3.7/5

Trigger conditions, audience, use cases, and non-fit boundaries are clearly stated, with host and BlueField Arm coverage and install-side capability probing. Deductions apply because Chinese-language support and mainland-China reachability are not addressed, core references depend on docs.nvidia.com, and platform/library support boundaries require external matrix verification.

Convention8 / 15 · 2.7/5

The skill uses layered SKILL.md, CAPABILITIES.md, and TASKS.md documentation with loading order, related skills, limitations, licensing, and routing guidance. Deductions apply because author, release version, signature, changelog, and maintenance responsibility remain TBD or indirect in SKILLCARD.yaml; the skill-card license conflicts with frontmatter, and static validation reported structural and recommended-section findings.

Effectiveness6 / 15 · 2.0/5

The skill clearly guides library, workload, and measurement-mode selection, baseline capture, smoke-before-bulk execution, and iterative diagnosis. Deductions apply because it provides no complete copy-ready commands or verified sample outputs, relies on the installed binary and external guide, and static evidence cannot establish usable real-world results.

Verifiability4 / 10 · 2.0/5

The material contains extensive internal cross-references, source-code symbols, and an evaluation report, providing some auditability. Deductions apply because the evaluation dataset is unavailable, the report cannot be independently reproduced, and there is no committed CI or test-suite evidence covering the skill's key paths.

Evidence confidence:Low Reviewed Jul 20, 2026 Reviewed revision 55f18499943e
Before you use it
  • Confirm the target device is not serving production traffic, and apply redaction and access controls to the companion-app channel, CSV files, logs, and environment data.
  • Do not use assumed parameters directly; verify them with doca_bench --help, the installed query results, and documentation matching the installed version.
  • Resolve the documentation inconsistency between four benchmark modes and the TASKS.md statement describing three modes; also reconcile SKILLCARD license, version, and signature metadata.
  • Users in mainland China should verify reachability of docs.nvidia.com, NGC, and other external references before relying on the workflow.
Review evidence [1][2][3][4][5][6][7][8][9]
See the full review method →

What does this skill do, and when should you use it?

This skill guides AI agents in using doca_bench to microbenchmark RDMA, Compress, AES-GCM, SHA, DMA, EC, Ethernet, Comch, and GPUNetIO. It covers capability enumeration, three-axis configuration, smoke-before-bulk execution, stability checks, baseline capture, and layered failure diagnosis. It requires DOCA SDK 2.7.0 or newer on Linux with a BlueField DPU or ConnectX NIC. It does not cover application end-to-end timing, DOCA installation, custom benchmark code, or binary modification.

Inspects the installed DOCA environment and enumerable benchmark libraries; configures tests by target library, workload shape, and measurement axis; runs throughput, bulk-latency, precision-latency, or maximum-bandwidth measurements; performs a smoke-before-bulk workflow; captures commands, versions, devices, deployed environment, and screen/CSV results; and diagnoses zero, hanging, unstable, or unexpected results across configuration, device binding, library prerequisites, workload prerequisites, measurement soundness, version, and cross-cutting layers.

  1. A platform operator reruns a BlueField or ConnectX baseline before and after a firmware, driver, or NUMA change.
  2. A performance engineer compares actual DOCA Compress, RDMA, DMA, or SHA throughput or latency on a target device.
  3. A developer checks whether a candidate DOCA library is exposed and measurable on the current installation before designing an application.
  4. An SRE produces a citable performance artifact containing the command, version, device, environment, and measurements.
  5. An AI agent investigates zero output, startup hangs, or unstable doca_bench results.

What are this skill's strengths and limitations?

Pros
  • Measures the user's actual installation and device instead of inferring performance from datasheet figures.
  • Covers multiple DOCA libraries and four measurement axes.
  • Requires recording command, version, device, and environment for regression analysis.
  • Provides workflows for capability probing, measurement soundness, and layered diagnosis.
Limitations
  • Requires DOCA SDK >= 2.7.0, a suitable Linux environment, and NVIDIA hardware; it does not install DOCA.
  • Ships no wrapper scripts, parsers, sample output, or expected throughput numbers.
  • Flag and scenario details are installation-specific and should not be invented from the skill text.
  • The source prompt provides no independent test-suite or platform-coverage evidence for this skill.

How do you install this skill?

Install the individual skill through the repository README's skills CLI flow:

npx skills add nvidia/skills --skill doca-bench --yes

Alternatively, run npx skills add nvidia/skills and select the skill and destination interactively. The repository is a catalog synchronized daily from product repositories; the skill becomes available the next time the agent loads relevant skills.

How do you use this skill?

On a Linux host meeting the prerequisites, or in an equivalent DOCA container, ask the agent for a doca_bench task such as: “Measure DOCA Compress throughput on my BlueField-3 and save a regression-testable baseline.” The workflow should verify the DOCA version and binary, enumerate enabled libraries, select throughput, bulk latency, precision latency, or maximum bandwidth, run a smoke test, and then assess stability. Remote-memory, RDMA, and Eth scenarios also require the companion app on the far side. Use the installed version's documentation and doca_bench --help for exact parameters.

How does this skill compare with similar options?

Unlike doca-caps, this skill performs fine-grained performance measurements while doca-caps provides a coarse per-device, per-library capability snapshot. Unlike application end-to-end benchmarking, it measures the DOCA library surface rather than the user's complete application. Unlike doca-setup, it assumes installation is already complete.

FAQ

What hardware and software are required?
Linux, DOCA SDK 2.7.0 or newer, the binary at /opt/mellanox/doca/tools/doca_bench, and an attached BlueField DPU or ConnectX NIC are required.
Does this skill install DOCA?
No. If DOCA is not installed, route to doca-setup; this skill covers doca_bench measurement in an existing installation.
What should I do when doca_bench returns no output or zero throughput?
Walk the configuration-syntax, device-binding, library-precondition, workload-precondition, measurement-soundness, version, and cross-cutting layers, and use doca-caps first when device or library visibility is uncertain.

More skills from this repository

All from NVIDIA/skills

Dev & Engineering ✓ NVIDIA · Official

DOCA Verbs Raw RDMA Control

Guides DOCA developers who genuinely need low-level verbs control, porting, and diagnosis.

Dev & Engineering ✓ NVIDIA · Official

DOCA Flow DPA Performance

Guides defensible measurement of DOCA Flow rule-update and disable rates on DPA-capable NVIDIA hardware.

Dev & Engineering ✓ NVIDIA · Official

DOCA Flow Performance Measurement

Guides reproducible, defensible measurements of host-side and DPU-CPU DOCA Flow control-plane rule rates.

Dev & Engineering ✓ NVIDIA · Official

DOCA GPUNetIO Development Skill

Helps developers connect CUDA kernels on NVIDIA GPUs to DOCA network queues for GPU-side packet I/O and debugging.

Dev & Engineering ✓ NVIDIA · Official

DOCA GPI GPU-Initiated RDMA Skill

Helps CUDA kernels drive RDMA queues directly from GPU memory without host-CPU mediation.

Dev & Engineering ✓ NVIDIA · Official

DOCA Hardware Telemetry Counter Reader

Guides developers in reading per-domain hardware counters from BlueField and ConnectX devices.

Automation & Ops ✓ NVIDIA · Official

DOCA Capabilities Inspector

Inspect what DOCA can see on a host through a read-only device and capability CLI.

Automation & Ops ✓ NVIDIA · Official

DOCA PCC Diagnostic Counters

Read fixed firmware and hardware PCC congestion diagnostics on ConnectX and BlueField devices.

Automation & Ops ✓ NVIDIA · Official

DOCA Management Service Operations

Operate and troubleshoot NVIDIA DMS for centralized BlueField and ConnectX management.

Dev & Engineering ✓ NVIDIA · Official

DOCA STA Storage Target Acceleration

Build and debug RDMA NVMe-oF storage targets accelerated by DOCA STA on BlueField.

Dev & Engineering ✓ NVIDIA · Official

DOCA Telemetry Exporter Development

Guides DOCA applications in defining, emitting, and debugging structured telemetry for external consumers.

Dev & Engineering ✓ NVIDIA · Official

DOCA Device Management Development Skill

Programmatically manage BlueField and ConnectX state through the DOCA C API.

Dev & Engineering ✓ NVIDIA · Official

DOCA SHA OpenSSL Offload Engine

Adds DOCA SHA hardware acceleration to existing OpenSSL pipelines without rewriting the application around the doca-sha C API.

Dev & Engineering ✓ NVIDIA · Official

DOCA Flow gRPC Remote Control

Deploy, secure, smoke-test, and troubleshoot DOCA Flow’s gRPC control plane for non-C++ clients.

Dev & Engineering ✓ NVIDIA · Official

DOCA Flow Tune

Guides engineers through snapshotting, analyzing, and optimizing live or captured DOCA Flow pipelines.

Dev & Engineering ✓ NVIDIA · Official

DOCA DPA High-Level Tracer

Capture and decode BlueField DPA programming events to diagnose kernel behavior, communication latency, and trace failures.

Dev & Engineering ✓ NVIDIA · Official

DOCA Compress Hardware Offload

Guides hands-on DEFLATE and LZ4 decompression development and debugging on BlueField and ConnectX platforms.

Dev & Engineering ✓ NVIDIA · Official

DOCA AES-GCM Acceleration

Configure, validate, and debug DOCA AES-GCM offload on BlueField DPUs and ConnectX NICs.

Dev & Engineering ✓ NVIDIA · Official

DOCA RDMA Initiator

Guides accelerator-initiated one-sided RDMA development on the DPA datapath.

Dev & Engineering ✓ NVIDIA · Official

DOCA SHA Acceleration

Guidance for offloading SHA hashing to NVIDIA BlueField and ConnectX hardware.

Related skills