Muse Spark Open 816B A42B on DGX Station GB300: VRAM, speed and fit
Muse Spark Open 816B A42B at 1.6-bit runs on the DGX Station GB300 with 1M of context at about 183 tokens a second.
Text generation · Chat · Ollama / LM Studio
Runs comfortably · on DGX Station GB300 · 1.6-bit (IQ1_S) · Ollama / LM Studio · Chat
- GPU memory
- 223 GB
- of 252 GB
- Context
- 1M
- auto
- Speed
- 183 tok/s
- 52 when full
- First reply
- 0.7 s
- 2K prompt
Where the memory goes
- Model
- 158 GB
- Context
- 64.4 GB
- Overhead
- 1.1 GB
- OS
- 0.0 GB
- Free
- 28.7 GB
- In RAM
- 0.0 GB
- Memory
- 223 GB of 252 GB
- Context
- 1M tokens · auto
- Speed
- 183 tok/s · 52 when full
- First reply
- 0.7 s for a 2K prompt
- Running cost
- $23/mo at home · $574/mo on a cloud 8× A40
Validation: Validated
| Check | Target | Result | Status |
|---|---|---|---|
| Fits in GPU memory | 252 GB usable | 223 GB needed | Pass |
| Headroom | 5% free | 28.7 GB free (11%) | Pass |
| Context for chat | 16K or more | 1M | Pass |
| Writing speed | 15 tok/s or more | 183 tok/s | Pass |
| First reply | under 3 s, 2K prompt | 0.7 s | Pass |
Targets: a reply you can read along with, a first reply the use case tolerates, and 5% of memory left free. Calculated from published specs, not benchmarked.
The setup
- Model
- Muse Spark Open 816B A42B
- Parameters
- 822B, 42B active
- Precision
- 1.6-bit (IQ1_S)
- Context
- 1M, auto
- Chats at once
- 1
- Use
- Chat
- Runs in
- Ollama / LM Studio
- Hardware
- DGX Station GB300
- GPU can use
- 252 GB of 252 GB
- Spill space
- 480 GB LPDDR5X on the Grace CPU
Running cost
- At home
- $23/mo
- 1040 W at the wall
- Renting instead
- $574/mo
- 8× A40 at $4.72/h
4 h a day, power at $0.18 per kWh, cloud at RunPod on-demand prices as of Nov 22, 2026.
How to run it
- llama.cpp
llama-server -hf unsloth/Muse-Spark-Open-816B-A42B-GGUF- vLLM
vllm serve meta-models/Muse-Spark-Open-816B-A42B- MLX (Mac)
mlx_lm.chat --model mlx-community/Muse-Spark-Open-816B-A42B-4bit
Muse Spark Open 816B A42B on similar machines
- Ryzen AI Max+ 395 128 GBToo big
- RTX SparkToo big
- DGX SparkToo big
- Dual DGX SparkRuns
- 2× RTX PRO 6000 BlackwellRuns
- 4× RTX PRO 6000 BlackwellRuns
- 8× RTX PRO 6000 BlackwellRuns
- A100 80 GB SXMToo big
All machines: Muse Spark Open 816B A42B VRAM requirements. Everything that runs here: what can the DGX Station GB300 run?
Other models that run on DGX Station GB300
Questions
Can Muse Spark Open 816B A42B run on DGX Station GB300?
Muse Spark Open 816B A42B at 1.6-bit runs on the DGX Station GB300 with 1M of context at about 183 tokens a second.
Report VR-1GP2ZRB, calculated Nov 22, 2026 from published specs, not benchmarked.