Deal of The Day! Hurry Up, Grab the Special Discount - Save 25% - Ends In 00:00:00 Coupon code: SAVE25
Welcome to Pass4Success

- Free Preparation Discussions

NVIDIA NCP-AII Exam - Topic 4 Question 15 Discussion

An engineer needs to validate NVLink Switch functionality on a DGX H100 system with 8 GPUs. Which NCCL command verifies intra-node NVLink bandwidth?
D) all_reduce_perf -b 8 -e 16G -f 2 -g 8 with NCCL_TESTS_SPLIT='OR 0x7'
A) broadcast_perf -b 8 -e 16G -f 2 -g 8 without split configuration
B) all_reduce_perf -b 8 -e 16G -f 2 -g 4 with NCCL_TESTS_SPLIT='MOD 2'
C) all_reduce_perf -b 8 -e 16G -f 2 -g 1 repeated 8 times

NVIDIA NCP-AII Exam - Topic 4 Question 15 Discussion

Actual exam question for NVIDIA's NCP-AII exam
Question #: 15
Topic #: 4
[All NCP-AII Questions]

An engineer needs to validate NVLink Switch functionality on a DGX H100 system with 8 GPUs. Which NCCL command verifies intra-node NVLink bandwidth?

Show Suggested Answer Hide Answer
Suggested Answer: D

The NVIDIA Collective Communications Library (NCCL) 'Tests' are used to verify the maximum achievable bandwidth of the interconnects. On a DGX H100, the GPUs are connected via a dedicated high-bandwidth NVLink Switch fabric (NVLink 4), which provides significantly higher throughput than PCIe. To validate the intra-node (within a single server) performance, the all_reduce_perf test is used. The command in Option D is specifically designed to stress all 8 GPUs (-g 8) across a wide range of message sizes (8 bytes to 16G). The use of the environment variable NCCL_TESTS_SPLIT with the bitwise 'OR' or 'AND' masks allows the engineer to isolate specific traffic patterns or groups of GPUs to ensure the NVLink switches are distributing the load evenly. For a standard 8-GPU H100 tray, achieving a 'Bus Bandwidth' of ~450 GB/s to 900 GB/s (depending on the precision and message size) confirms that the NVLink fabric is operating at its theoretical peak. Using only 4 GPUs (Option B) or 1 GPU (Option C) would not provide a complete picture of the NVLink switch bisection bandwidth.


Contribute your Thoughts:

0/2000 characters
Cordell
2 hours ago
I feel like option D might be the right choice since it mentions NVLink and uses a split configuration, but I need to double-check the details.
upvoted 0 times
...
Blair
5 days ago
I remember practicing with all_reduce_perf, but I can't recall if the split configuration is necessary for this specific test.
upvoted 0 times
...
Talia
10 days ago
I think the command we need is related to bandwidth testing, but I'm not sure if it's the broadcast or all_reduce command.
upvoted 0 times
...

Save Cancel