180 GB VRAM and 8,000 GB/s of memory bandwidth. The strongest single-device fits at 4-bit are Inkling Small (~8889 tok/s), MiniMax M2.5 (~1455 tok/s), Gemma 4 31B (~511 tok/s), Qwen3 235B (Thinking) (~727 tok/s) and Qwen3 32B (~488 tok/s).
66 open-weight models fit in B200 180 GB at 4-bit, ranked by Analyzer Index. Renting costs $4,015 a month at 24 h/day.
| Model | Index | Memory | Est. tok/s | API $/month | Verdict |
|---|---|---|---|---|---|
| Inkling Small Thinking Machines266B · 1.8B active | 62.2 | 160 GB | ~8889 | $75.00 | API is cheaper |
| MiniMax M2.5 MiniMax228.7B · 11B active | 57.8 | 137 GB | ~1455 | $50.75 | API is cheaper |
| Gemma 4 31B Google31.3B | 57.4 | 19 GB | ~511 | $18.50 | API is cheaper |
| Qwen3 235B (Thinking) Alibaba (Qwen)235.1B · 22B active | 51.6 | 141 GB | ~727 | $133 | API is cheaper |
| Qwen3 32B Alibaba (Qwen)32.8B | 50.0 | 20 GB | ~488 | $15.00 | API is cheaper |
| gpt-oss-120b OpenAI116.8B · 5.7B active | 45.8 | 70 GB | ~2807 | $6.75 | API is cheaper |
| Qwen3 235B Alibaba (Qwen)235.1B · 22B active | 44.1 | 141 GB | ~727 | $17.50 | API is cheaper |
| QwQ 32B Alibaba (Qwen)32.8B | 37.2 | 20 GB | ~488 | — | no API price |
| gpt-oss-20b OpenAI20.9B · 4.2B active | 35.2 | 13 GB | ~3810 | $4.05 | API is cheaper |
| Gemma 3 27B Google27.4B | 28.5 | 16 GB | ~584 | $12.00 | API is cheaper |
| Mistral Large 2 Mistral122.6B | 26.8 | 74 GB | ~131 | $350 | API is cheaper |
| Llama 3.1 70B Instruct Meta70.6B | 24.3 | 42 GB | ~227 | $50.00 | API is cheaper |
| Llama 3.3 70B Instruct Meta70.6B | 20.9 | 42 GB | ~227 | $18.00 | API is cheaper |
| Llama 4 Scout Meta108.6B · 17B active | 12.3 | 65 GB | ~941 | $14.00 | API is cheaper |
| Nemotron 3.5 Lightning NVIDIA31.6B · 3B active | — | 19 GB | ~5333 | $5.50 | API is cheaper |
| Qwen3.6 35B A3B Alibaba (Qwen)36B · 3B active | — | 22 GB | ~5333 | $22.50 | API is cheaper |
| Qwen3.5-35B-A3B Alibaba (Qwen)36B · 3B active | — | 22 GB | ~5333 | $25.25 | API is cheaper |
| Nemotron 3 Nano 30B A3B NVIDIA31.6B · 3B active | — | 19 GB | ~5333 | $10.00 | API is cheaper |
| Qwen3 VL 30B A3B Thinking Alibaba (Qwen)31.1B · 3B active | — | 19 GB | ~5333 | $54.00 | API is cheaper |
| Qwen3 VL 30B A3B Instruct Alibaba (Qwen)31.1B · 3B active | — | 19 GB | ~5333 | $30.00 | API is cheaper |
| Qwen3 Next 80B A3B Thinking Alibaba (Qwen)81.3B · 3B active | — | 49 GB | ~5333 | $45.00 | API is cheaper |
| Qwen3 Next 80B A3B Instruct Alibaba (Qwen)81.3B · 3B active | — | 49 GB | ~5333 | $29.20 | API is cheaper |
| Qwen3 Coder 30B A3B Instruct Alibaba (Qwen)30.5B · 3B active | — | 18 GB | ~5333 | $14.00 | API is cheaper |
| Qwen3 30B A3B Instruct 2507 Alibaba (Qwen)30.5B · 3B active | — | 18 GB | ~5333 | $16.50 | API is cheaper |
| Hunyuan A13B Instruct Tencent (Hunyuan)80.4B · 3B active | — | 48 GB | ~5333 | $28.25 | API is cheaper |
| Qwen3 30B A3B Alibaba (Qwen)30.5B · 3B active | — | 18 GB | ~5333 | $24.50 | API is cheaper |
| Ministral 3 3B 2512 Mistral3.8B | — | 2 GB | ~4211 | $12.50 | API is cheaper |
| Qwen3 Coder Next Alibaba (Qwen)79.7B · 3.9B active | — | 48 GB | ~4103 | $32.00 | API is cheaper |
| Gemma 4 26B A4B Google25.8B · 4B active | — | 16 GB | ~4000 | $9.70 | API is cheaper |
| Gemma 3 4B Google4.3B | — | 3 GB | ~3721 | $5.25 | API is cheaper |
| GLM 4.7 Flash Zhipu AI (GLM)31.2B · 4.6B active | — | 19 GB | ~3478 | $16.05 | API is cheaper |
| Mistral Small 4 Mistral119.4B · 7.1B active | — | 72 GB | ~2254 | $30.00 | API is cheaper |
| Stable Diffusion 3.5 Large Stability AI8.1B | — | 5 GB | ~1975 | — | no API price |
| Qwen3 VL 8B Instruct Alibaba (Qwen)8.8B | — | 5 GB | ~1818 | $43.75 | API is cheaper |
| Ministral 3 8B 2512 Mistral8.9B | — | 5 GB | ~1798 | $18.75 | API is cheaper |
| Qwen3.5-9B Alibaba (Qwen)9.7B | — | 6 GB | ~1649 | $11.25 | API is cheaper |
| Qwen3.5-122B-A10B Alibaba (Qwen)125.1B · 10B active | — | 75 GB | ~1600 | $78.00 | API is cheaper |
| MiniMax M2.7 MiniMax228.7B · 11B active | — | 137 GB | ~1455 | $42.00 | API is cheaper |
| MiniMax M2.1 MiniMax228.7B · 11B active | — | 137 GB | ~1455 | $60.00 | API is cheaper |
| MiniMax M2 MiniMax228.7B · 11B active | — | 137 GB | ~1455 | $51.00 | API is cheaper |
| FLUX.1 [dev] Black Forest Labs11.9B | — | 7 GB | ~1345 | — | no API price |
| Nemotron 3 Super NVIDIA123.6B · 12B active | — | 74 GB | ~1333 | $18.50 | API is cheaper |
| Gemma 3 12B Google12.2B | — | 7 GB | ~1311 | $7.00 | API is cheaper |
| Ministral 3 14B 2512 Mistral13.9B | — | 8 GB | ~1151 | $25.00 | API is cheaper |
| GLM 4.6V Zhipu AI (GLM)107.7B · 14.3B active | — | 65 GB | ~1119 | $52.50 | API is cheaper |
| GLM 4.5V Zhipu AI (GLM)107.7B · 14.3B active | — | 65 GB | ~1119 | $105 | API is cheaper |
| Qwen3 14B Alibaba (Qwen)14.8B | — | 9 GB | ~1081 | $15.50 | API is cheaper |
| GLM 4.5 Air Zhipu AI (GLM)110.5B · 15B active | — | 66 GB | ~1067 | $34.25 | API is cheaper |
| Qwen3 VL 235B A22B Instruct Alibaba (Qwen)235.7B · 22B active | — | 141 GB | ~727 | $42.00 | API is cheaper |
| Mistral Small 3 Mistral23.6B | — | 14 GB | ~678 | $7.00 | API is cheaper |
| Mistral Small 3.2 24B Mistral24B | — | 14 GB | ~667 | $12.50 | API is cheaper |
| Mistral Small 3.1 24B Mistral24B | — | 14 GB | ~667 | $48.97 | API is cheaper |
| Voxtral Small 24B 2507 Mistral24.3B | — | 15 GB | ~658 | $17.50 | API is cheaper |
| Qwen3.8 27B Alibaba (Qwen)27.8B | — | 17 GB | ~576 | $14.50 | API is cheaper |
| Qwen3.6 27B Alibaba (Qwen)27.8B | — | 17 GB | ~576 | $70.00 | API is cheaper |
| Qwen3.5-27B Alibaba (Qwen)27.8B | — | 17 GB | ~576 | $58.50 | API is cheaper |
| Muse Glimmer 30B Meta29.8B | — | 18 GB | ~537 | $60.00 | API is cheaper |
| Mixtral 8x22B Mistral140.6B · 44B active | — | 84 GB | ~364 | $350 | API is cheaper |
| Qwen3.8 Flash Alibaba (Qwen)180B · 61.6B active | — | 108 GB | ~260 | $26.75 | API is cheaper |
| Qwen2.5 72B Instruct Alibaba (Qwen)72.7B | — | 44 GB | ~220 | $46.00 | API is cheaper |
| Qwen2.5 VL 72B Instruct Alibaba (Qwen)73.4B | — | 44 GB | ~218 | $105 | API is cheaper |
| Command A Cohere111.1B | — | 67 GB | ~144 | $500 | API is cheaper |
| Devstral 2 2512 Mistral125B | — | 75 GB | ~128 | $90.00 | API is cheaper |
| Step 3.5 Flash StepFun199.4B | — | 120 GB | ~80.2 | $17.50 | API is cheaper |
| Step 3.7 Flash StepFun201.4B | — | 121 GB | ~79.4 | $48.75 | API is cheaper |
| MiniMax M3.1 Flash MiniMax220.5B | — | 132 GB | ~72.6 | $21.50 | API is cheaper |
Memory need is weights × 1.2 for runtime overhead. Speed is a theoretical single-stream ceiling (memory bandwidth ÷ active-weight bytes); real engines usually reach 50–80% of it, and batching many requests raises total throughput well beyond one stream. Rental and purchase prices are typical figures checked 2026-10-14; power and engineering time are not included.