NVIDIA DGX B200
NVIDIA's current flagship AI server, with enough per-node memory to run even the largest open-source models we sell without a multi-node cluster.
1440 GB
GPU Memory vs. tier max
14300 W
Power vs. tier max
$387,500
Price vs. tier max
| The dedicated memory built into the graphics card. An AI model's entire set of "weights" (its learned parameters) must fit into this memory before the card can run it. If a model needs more VRAM than one card has, you need multiple cards working together, or a card with more memory. | 1440 GB total across 8 GPUs (180 GB each) |
|---|---|
| The general-purpose "brain" of the server that manages the operating system, feeds data to the GPUs, and handles tasks the GPUs aren't built for. More cores let it keep many GPUs fed with data at once. | Dual Intel Xeon Platinum 8570 (112 cores total, 2.1GHz base / 4GHz boost) |
| Fast temporary memory used by the CPU (separate from GPU VRAM). Large AI servers need a lot of it to stage data, run the operating system, and manage many simultaneous requests. | 2048 GB (2.0 TB) |
| Thermal Design Power — roughly how many watts the card draws under full load. Higher-performance cards need more electricity and generate more heat, which affects your electricity bill and cooling needs. | 14300 W |
| Approximate cost to acquire the hardware. For consumer cards this is usually a fixed retail price. For datacenter-class hardware, list prices are rarely published — buyers negotiate directly with NVIDIA or its partners, so we show a typical range or say "contact for pricing" rather than inventing a number. |
$387,500
No public price found anywhere — contact NVIDIA/partners for a quote. Unverified secondary reports range widely, roughly $275,000-$500,000.
|
Why this matters
A card or server needs at least as much
The dedicated memory built into the graphics card. An AI model's entire set of "weights" (its learned parameters) must fit into this memory before the card can run it. If a model needs more VRAM than one card has, you need multiple cards working together, or a card with more memory.
as an AI model requires,
or the model simply won't load. See Get a Recommendation
to see which models this hardware can run, or
add it to a side-by-side comparison.