Dev & Engineering ✓ NVIDIA · Official rdmagpunetiocudainfiniBandlatency-benchmarkperformance-engineering

GPUNetIO RDMA Write Latency Benchmark

Guides reproducible measurement of CUDA-kernel-initiated GPUNetIO RDMA WRITE latency and tail behavior.

FollowSkills review · FSRS-2.0
Not recommended
52/ 100 5-point scale 2.6 / 5
Trust16 / 25 · 3.2/5

The skill scopes the task and discloses GPU/NIC, CUDA, DOCA, TCP, and RDMA data flows; it also addresses trusted OOB networking, handle lifetime, and routing of hardware changes through a safety policy. It lacks explicit user-confirmation gates, least-privilege guidance, rollback procedures, and detailed sensitive-output handling, while license metadata is inconsistent, so points are deducted.

Reliability8 / 20 · 2.0/5

The documentation provides prerequisites, build/run sequencing, layered error taxonomy, and failure routing, making the happy path plausible. However, it depends on companion files, real DOCA hardware, and a prepared installation; some output and iteration claims are not reproducibly specified, and static review cannot validate key paths, so the score is capped and reduced.

Adaptability11 / 15 · 3.7/5

Triggers, audience, non-fit boundaries, and the GPUNetIO/GPI/CPU distinction are comparatively clear. Chinese-language support is not demonstrated, and some guidance depends on external DOCA documentation and specialized hardware; reachability from mainland-China networks is not established, so points are deducted.

Convention8 / 15 · 2.7/5

The information architecture, loading order, task routing, limitation disclosures, and maintenance contacts are useful. Author, stable version, changelog, and explicit update ownership are incomplete; the SKILLCARD contains TBD fields, and benchmark paths, repository paths, and license declarations are inconsistent, so points are deducted.

Effectiveness6 / 15 · 2.0/5

The skill can materially guide GPU-initiated RDMA WRITE latency measurement, statistic selection, topology qualification, and troubleshooting. It is a thin loader without scripts, parsers, or representative expected outputs, requires user-side compilation on specialized hardware, and leaves substantial result preparation to the user, so points are deducted.

Verifiability3 / 10 · 1.5/5

The files cite common.h, meson.build, source layout, and an evaluation report, providing some traceability. The key companion source files are not included in the supplied evidence, the evaluation dataset is unavailable, and the report is not independently reproducible CI/test evidence, so only a low score is justified.

Evidence confidence:Low Reviewed Jul 20, 2026 Reviewed revision 55f18499943e
The upstream repository has new commits since this review. The score still applies to the reviewed revision shown and may not cover the latest changes.
Before you use it
  • No commands were executed; key build, runtime, distribution, and failure paths were not independently reproduced.
  • SKILL.md states Apache-2.0, while the SKILLCARD states Apache 2.0 AND CC-BY-4.0, and the supplied license metadata is NOASSERTION; this should be reconciled before publication.
  • The benchmark report lacks its source dataset and per-task records, so PASS and percentage results cannot be treated as independent verification.
  • The documentation requests full unredacted stdout without clearly specifying how host, network, or environment-sensitive data should be handled.
  • Reachability of external DOCA documentation in the target user environment should be confirmed, and Chinese-language triggers and guidance should be added.
Review evidence [1][2][3][4][5][6][7][8][9]
See the full review method →

What does this skill do, and when should you use it?

This skill is for developers and performance engineers evaluating RDMA WRITE latency initiated from a GPU kernel through doca-gpunetio. It covers the `gpunetio_ib_write_lat` client/server ping-pong benchmark, including build and run guidance, GPU-NIC pairing, and environment checks. It explains the half-iter, full-iter, and CUDA-side usec columns and the use of median, p99, and jitter. It is useful for measured infrastructure baselines, but it does not represent the latency of an entire real-time application pipeline.

Guides the agent to check the DOCA SDK, CUDA Toolkit, nvidia_peermem, GPU-NIC topology, and pkg-config dependencies; build the C/CUDA client and server with Meson from /opt/mellanox/doca/tools/gpunetio_ib_write_lat; run the two-sided RDMA WRITE ping-pong benchmark; interpret half-iter, full-iter, and CUDA-side usec output; characterize median, p99, and jitter; and compare GPUNetIO with GPI and CPU-initiated perftest.

  1. A real-time control-loop developer validates whether GPU-initiated WRITE tail latency meets a deadline between two GPU and ConnectX-equipped hosts.
  2. A platform operator reruns the benchmark after changing NUMA placement, GPU PCIe topology, IB device selection, GID index, or NIC firmware.
  3. A performance engineer documents median, p99, jitter, software versions, hardware, and deployment conditions for regression analysis.
  4. A team chooses between the GPUNetIO and GPI programming surfaces or the CPU-initiated `perftest` path.
  5. A CUDA developer evaluates the latency and GPU-side overhead trade-off of batching multiple work requests.

What are this skill's strengths and limitations?

Pros
  • Narrowly focused on CUDA-kernel-initiated RDMA WRITE latency through doca-gpunetio.
  • Covers build, smoke testing, evaluation, output semantics, and tail-latency reporting.
  • Encourages recording hardware, software versions, and deployment state for reproducibility.
  • Clearly distinguishes GPUNetIO, GPI, and CPU-initiated `perftest` paths.
Limitations
  • Requires a GPU-NIC pair on each endpoint plus DOCA, CUDA, `nvidia_peermem`, and InfiniBand-capable hardware.
  • The skill is agent guidance rather than a scripts, parser, bindings, or samples bundle.
  • It intentionally omits fixed flags and expected latency values; the installed binary and source must be checked.
  • The benchmark measures GPUNetIO WR latency, not the full application pipeline or end-to-end control-loop deadline.
  • The supplied material includes no platform test results, test suite, or benchmark numbers.

How do you install this skill?

Install the skill from the NVIDIA/skills collection with: npx skills add nvidia/skills --skill doca-gpunetio-ib-write-lat --yes. The host must also meet the stated Linux, DOCA SDK, CUDA Toolkit, GPU, InfiniBand-capable ConnectX or BlueField RNIC, and loaded nvidia_peermem requirements. The source does not provide a standalone installer or complete DOCA installation command.

How do you use this skill?

After installation, ask the agent something like: “Measure GPUNetIO GPU-init RDMA WRITE latency between two H100 + ConnectX hosts and report median, p99, and jitter separately.” The agent should verify the GPU-NIC and DOCA/CUDA prerequisites, then follow the referenced TASKS.md configure, build, run, and test workflows. Use the installed binary’s --help and main.c registration as the authority for exact flags.

How does this skill compare with similar options?

GPUNetIO is the runtime surface benchmarked here. GPI is an alternative programming surface for the same physical operation, but doca/tools/ does not ship a GPI ib_write_lat benchmark binary. Upstream perftest ib_write_lat measures CPU-initiated WRITE latency. The related doca-gpunetio-ib-write-bw skill covers bandwidth rather than latency.

FAQ

Does this skill install DOCA?
No. It assumes DOCA is already installed at `/opt/mellanox/doca` and routes installation work to a DOCA setup skill.
What permissions and connectivity are required?
The workflow uses client and server hosts with GPU-NIC pairs and an OOB TCP socket. It assumes the operator has the privileges expected for binding a `doca_dev`, a `doca_gpu`, and the OOB TCP socket.
Should a real-time workload quote median or p99?
Use p99 and jitter alongside the deadline because median describes typical behavior and does not capture tail spikes.
Is there a stated cost or license?
The source gives no pricing information. The skill is marked Apache-2.0; the repository README describes the collection as dual-licensed under Apache 2.0 and CC BY 4.0.

More skills from this repository

All from NVIDIA/skills

Dev & Engineering ✓ NVIDIA · Official

DOCA GPUNetIO WRITE Bandwidth Benchmark

Build, run, and interpret sustained RDMA WRITE bandwidth measurements driven by CUDA kernels through the DOCA GPUNetIO surface.

Dev & Engineering ✓ NVIDIA · Official

DOCA GPI GPU-Initiated RDMA Skill

Helps CUDA kernels drive RDMA queues directly from GPU memory without host-CPU mediation.

Dev & Engineering ✓ NVIDIA · Official

DOCA Bench Extension Builder

Build, load, smoke-test, and debug custom doca-bench plug-ins for workloads beyond built-in modes.

Dev & Engineering ✓ NVIDIA · Official

DOCA GPUNetIO Development Skill

Helps developers connect CUDA kernels on NVIDIA GPUs to DOCA network queues for GPU-side packet I/O and debugging.

Automation & Ops ✓ NVIDIA · Official

DOCA Bench Benchmarking Skill

Measure DOCA library throughput, latency, and bandwidth reproducibly on real NVIDIA networking hardware.

Dev & Engineering ✓ NVIDIA · Official

CuTile Autotuning Guide

Design, implement, and validate low-overhead autotuning for CuTile GPU kernels.

Dev & Engineering ✓ NVIDIA · Official

TileGym cuTile Kernel Optimizer

Systematically reduce cuTile GPU kernel latency through profiling, bottleneck diagnosis, and controlled tuning.

Dev & Engineering ✓ NVIDIA · Official

NeMo MBridge GPU Memory Tuning

Diagnose GPU OOMs in Megatron Bridge training and reduce fragmentation, activation, and PEFT memory usage.

Data & Analysis ✓ NVIDIA · Official

NV-Segment-CT Medical Imaging Segmentation Skill

Run VISTA3D on CT NIfTI volumes and produce verifiable label-map evidence.

Data & Analysis ✓ NVIDIA · Official

NV-Segment-CT Fine-Tuning

Fine-tune NV-Segment-CT VISTA3D on labeled CT NIfTI datasets.

Dev & Engineering ✓ NVIDIA · Official

cuPyNumeric Migration Readiness

Assess whether NumPy code is ready to scale on GPUs before committing to a substantial cuPyNumeric port.

Dev & Engineering ✓ NVIDIA · Official

DOCA RDMA Initiator

Guides accelerator-initiated one-sided RDMA development on the DPA datapath.

Data & Analysis ✓ NVIDIA · Official

NV-Generate-MR

Generate synthetic body MRI volumes through NVIDIA’s rflow-mr workflow.

Dev & Engineering ✓ NVIDIA · Official

DOCA Verbs Raw RDMA Control

Guides DOCA developers who genuinely need low-level verbs control, porting, and diagnosis.

Automation & Ops ✓ NVIDIA · Official

Jetson Package & Environment Advisor

Select Jetson-compatible containers and GPU package indexes by device architecture.

Data & Analysis ✓ NVIDIA · Official

NV-Generate-CT Synthetic CT Generator

Generate paired synthetic CT volumes and masks through NVIDIA’s rflow-ct pipeline.

Dev & Engineering ✓ NVIDIA · Official

DOCA STA Storage Target Acceleration

Build and debug RDMA NVMe-oF storage targets accelerated by DOCA STA on BlueField.

Dev & Engineering ✓ NVIDIA · Official

Holoscan SDK Setup Guide

Inspects a Linux host and selects the most suitable Holoscan SDK installation path.

Automation & Ops ✓ NVIDIA · Official

TAO NVIDIA GPU Host Setup

Checks and standardizes NVIDIA drivers, CUDA, and container runtime prerequisites for TAO GPU hosts.

Dev & Engineering ✓ NVIDIA · Official

NVIDIA Skill Finder

Finds the right NVIDIA agent skill for product, hardware, and workflow requests.

Related skills