Apple M1, 8 GB · Llama 3.3 70B Instruct · Q4_K_M
No. Llama 3.3 70B Instruct at Q4_K_M does not fit on Apple M1, 8 GB at 8,192 tokens, even with 8 GB of system RAM.
| Piece | Value | Note |
|---|---|---|
| Weights | 39.6 GiB | Llama-3.3-70B-Instruct-Q4_K_M.gguf |
| KV cache | 2.50 GiB | 8,192 tokens |
| Engine overhead | 0.50 GiB | Flat 0.5 GiB allowance |
| 5% headroom | 2.13 GiB | On the sum above |
| Total | 44.7 GiB | No |
| Fast memory | 5.00 GiB | After OS reserve |
| Speed | — | Dense bandwidth range |
ollama run llama3.3:70b
Apple M1, 8 GB · Llama 3.3 70B Instruct ·GGUF file · Methodology
FAQ
How was this fit calculated?
Weights 39.6 GiB, KV cache 2.50 GiB at 8,192 tokens, engine overhead 0.50 GiB, then 5% headroom, for 44.7 GiB. Fast memory available is 5.00 GiB.
What if I change the quant or the context?
This page is Q4_K_M at 8,192 tokens. A smaller quant or a shorter context lowers the total. The homepage calculator changes both without a new page.
Can I trust the tokens per second?
No speed is shown because the model does not load.
What do I type?
ollama run llama3.3:70b
Is Apple M1, 8 GB assumed to have extra RAM?
No separate RAM pool. The chip's unified memory is the whole budget, minus the OS reserve described on the methodology page.