Job Resources¶
Specify the number of GPUs when submitting a job. The supported GPU counts are 1, 2, 3, 4, 8, 12, and 16. The number of allocated nodes, the maximum number of CPU cores, and the maximum memory amount depend on the number of GPUs.
| Number of GPUs | Allocated nodes | Maximum CPU cores/node | Maximum memory/node | Maximum wall time |
|---|---|---|---|---|
| 1 | 1 | 36 | 400 GB | 96 hours |
| 2 | 72 | 800 GB | ||
| 3 | 108 | 1,200 GB | ||
| 4 | 144 | 1,600 GB | ||
| 8 | 2 | |||
| 12 | 3 | |||
| 16 | 4 |
Note
The maximum memory amount in the table is an estimate of the combined usable GPU memory and CPU memory. GPU memory is 173.2 GiB per GPU. In GB200 NVL4, the CPU and GPU are connected through NVLink-C2C with cache coherency, so the CPU and GPU can access each other's memory. Note that CPU memory and GPU memory have different performance characteristics.