OpenAI · 117B · MXFP4 · 59.0 GiB
gpt-oss-120b at MXFP4 needs about 62.8 GiB at 8K context, and the smallest listed machine that fits it is Apple M2 Max, 96 GB.
Larger gpt-oss MoE. MXFP4 file. 4 of 128 experts run each token.
ollama run gpt-oss:120b
Weights: gpt-oss-120b-MXFP4.gguf. Architecture: config source. Hugging Face repo created 2025-08-04. License field: apache-2.0.
Quants with a measured file size
| Quant | File | Size |
|---|---|---|
| MXFP4 · recommended | gpt-oss-120b-MXFP4.gguf | 59.0 GiB |
Machines
| Machine | Memory | Total | Verdict | Speed |
|---|---|---|---|---|
| Apple M1, 8 GB | 8 GB unified | 62.8 GiB | No | — |
| Apple M2, 8 GB | 8 GB unified | 62.8 GiB | No | — |
| Apple M3, 8 GB | 8 GB unified | 62.8 GiB | No | — |
| GeForce RTX 3060 Ti | 8 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 3070 | 8 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 4060 | 8 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 4060 Ti 8GB | 8 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 5060 | 8 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 5060 Ti 8GB | 8 GB GDDR | 62.8 GiB | No | — |
| Radeon RX 6600 | 8 GB GDDR6 | 62.8 GiB | No | — |
| Radeon RX 7600 | 8 GB GDDR6 | 62.8 GiB | No | — |
| GeForce RTX 3080 10GB | 10 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 3060 12GB | 12 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 4070 | 12 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 4070 Super | 12 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 4070 Ti | 12 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 5070 | 12 GB GDDR | 62.8 GiB | No | — |
| Intel Arc B580 | 12 GB GDDR6 | 62.8 GiB | No | — |
| Radeon RX 6700 XT | 12 GB GDDR6 | 62.8 GiB | No | — |
| Radeon RX 7700 XT | 12 GB GDDR6 | 62.8 GiB | No | — |
| Apple M1 Pro, 16 GB | 16 GB unified | 62.8 GiB | No | — |
| Apple M1, 16 GB | 16 GB unified | 62.8 GiB | No | — |
| Apple M2 Pro, 16 GB | 16 GB unified | 62.8 GiB | No | — |
| Apple M2, 16 GB | 16 GB unified | 62.8 GiB | No | — |
| Apple M3, 16 GB | 16 GB unified | 62.8 GiB | No | — |
| Apple M4, 16 GB | 16 GB unified | 62.8 GiB | No | — |
| GeForce RTX 4060 Ti 16GB | 16 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 4070 Ti Super | 16 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 4080 | 16 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 4080 Super | 16 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 5060 Ti 16GB | 16 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 5070 Ti | 16 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 5080 | 16 GB GDDR | 62.8 GiB | No | — |
| Intel Arc A770 16GB | 16 GB GDDR6 | 62.8 GiB | No | — |
| Legion Go | 16 GB LPDDR5X-7500 | 62.8 GiB | No | — |
| Radeon RX 6800 XT | 16 GB GDDR6 | 62.8 GiB | No | — |
| Radeon RX 7800 XT | 16 GB GDDR6 | 62.8 GiB | No | — |
| Radeon RX 9060 XT 16GB | 16 GB GDDR6 | 62.8 GiB | No | — |
| Radeon RX 9070 XT | 16 GB GDDR6 | 62.8 GiB | No | — |
| ROG Ally | 16 GB LPDDR5-6400 | 62.8 GiB | No | — |
| Steam Deck LCD | 16 GB LPDDR5-5500 | 62.8 GiB | No | — |
| Steam Deck OLED | 16 GB LPDDR5-6400 | 62.8 GiB | No | — |
| Apple M3 Pro, 18 GB | 18 GB unified | 62.8 GiB | No | — |
| Radeon RX 7900 XT | 20 GB GDDR6 | 62.8 GiB | No | — |
| Apple M2, 24 GB | 24 GB unified | 62.8 GiB | No | — |
| Apple M3, 24 GB | 24 GB unified | 62.8 GiB | No | — |
| Apple M4 Pro, 24 GB | 24 GB unified | 62.8 GiB | No | — |
| Apple M4, 24 GB | 24 GB unified | 62.8 GiB | No | — |
| GeForce RTX 3090 | 24 GB GDDR | 62.8 GiB | No | — |
| GeForce RTX 4090 | 24 GB GDDR | 62.8 GiB | No | — |
| Radeon RX 7900 XTX | 24 GB GDDR6 | 62.8 GiB | No | — |
| ROG Ally X | 24 GB LPDDR5X-7500 | 62.8 GiB | No | — |
| Apple M1 Max, 32 GB | 32 GB unified | 62.8 GiB | No | — |
| Apple M1 Pro, 32 GB | 32 GB unified | 62.8 GiB | No | — |
| Apple M2 Max, 32 GB | 32 GB unified | 62.8 GiB | No | — |
| Apple M2 Pro, 32 GB | 32 GB unified | 62.8 GiB | No | — |
| Apple M4, 32 GB | 32 GB unified | 62.8 GiB | No | — |
| GeForce RTX 5090 | 32 GB GDDR | 62.8 GiB | No | — |
| Apple M3 Pro, 36 GB | 36 GB unified | 62.8 GiB | No | — |
| Apple M4 Max 14-core, 36 GB | 36 GB unified | 62.8 GiB | No | — |
| Apple M3 Max 16-core, 48 GB | 48 GB unified | 62.8 GiB | No | — |
| Apple M4 Max 16-core, 48 GB | 48 GB unified | 62.8 GiB | No | — |
| Apple M4 Pro, 48 GB | 48 GB unified | 62.8 GiB | No | — |
| Apple M1 Max, 64 GB | 64 GB unified | 62.8 GiB | No | — |
| Apple M2 Max, 64 GB | 64 GB unified | 62.8 GiB | No | — |
| Apple M3 Max 16-core, 64 GB | 64 GB unified | 62.8 GiB | No | — |
| Apple M4 Max 16-core, 64 GB | 64 GB unified | 62.8 GiB | No | — |
| Apple M4 Pro, 64 GB | 64 GB unified | 62.8 GiB | No | — |
| Apple M2 Max, 96 GB | 96 GB unified | 62.8 GiB | Fits | 65–103 tok/s |
| Apple M3 Max 16-core, 128 GB | 128 GB unified | 62.8 GiB | Fits | 65–103 tok/s |
| Apple M4 Max 16-core, 128 GB | 128 GB unified | 62.8 GiB | Fits | 88–141 tok/s |
Exact answers
FAQ
Why MXFP4?
MXFP4 is the quant this page recommends. The file is gpt-oss-120b-MXFP4.gguf at 59.0 GiB. Other single-file quants are in the table when a real size was available.
Where do the architecture numbers come from?
num_local_experts 128, num_experts_per_tok 4, sliding_window 128. Source: https://huggingface.co/openai/gpt-oss-120b/raw/main/config.json
Does this include a long context?
The fit uses 8,192 tokens, or less when that is all the fast memory can hold. The model file allows up to 131,072 tokens, and KV cache grows as you use more of that.
What is the Ollama command?
ollama run gpt-oss:120b. The library tag is Q4-class or the vendor quant. Compare it with the GGUF linked on this page before you treat the sizes as identical.