Skip to content

Muse Glimmer 30B on RTX 3060 12 GB: VRAM, speed and fit

Muse Glimmer 30B at 4-bit needs 18.0 GB; the RTX 3060 12 GB can use 12.0 GB. The smallest machine we checked that runs it is the RTX 4000 SFF Ada.

Text generation · Chat · Ollama / LM Studio

Won’t fit · on RTX 3060 12 GB · 4-bit (Q4_K_M) · Ollama / LM Studio · Chat

GPU memory
18.0 GB
of 12.0 GB
Context
8K
auto
Speed
n/a
First reply
n/a

Where the memory goes

Model
16.8 GB
Context
182 MB
Overhead
1.0 GB
OS
0.0 GB
Over by
6.0 GB
Memory
18.0 GB of 12.0 GB
Context
8K tokens · auto
Speed
Doesn’t run here
Running cost
Doesn’t run here · $30/mo on a cloud RTX A4500

Validation: Not validated

What Muse Glimmer 30B on RTX 3060 12 GB was checked against
CheckTargetResultStatus
Fits in GPU memory12.0 GB usable18.0 GB neededFails
Headroom5% freenoneFails
Context for chat16K or more–Not run
Writing speed15 tok/s or more–Not run
First replyunder 3 s, 2K prompt–Not run

Targets: a reply you can read along with, a first reply the use case tolerates, and 5% of memory left free. Calculated from published specs, not benchmarked.

The setup

Model
Muse Glimmer 30B
Parameters
29.8B
Precision
4-bit (Q4_K_M)
Context
8K, auto
Chats at once
1
Use
Chat
Runs in
Ollama / LM Studio
Hardware
RTX 3060 12 GB
GPU can use
12.0 GB of 12.0 GB

Worth trying

  • 2× RTX 3060 12 GB: Fits across the cards, 128K context
  • Spill to RAM: Runs, slower, 5.4 tok/s
  • RTX 4000 SFF Ada: Runs it with 80K context
  • M5 Max · 36 GB: Runs it with 128K context

Running cost

At home
n/a
Doesn’t run on this machine.
Renting instead
$30/mo
RTX A4500 at $0.25/h

4 h a day, power at $0.18 per kWh, cloud at RunPod on-demand prices as of Nov 21, 2026.

How to run it

Ollama
ollama run muse-glimmer:30b
llama.cpp
llama-server -hf unsloth/Muse-Glimmer-30B-GGUF
vLLM
vllm serve meta-models/Muse-Glimmer-30B
MLX (Mac)
mlx_lm.chat --model mlx-community/Muse-Glimmer-30B-4bit

Muse Glimmer 30B on similar machines

  • RTX 4060Too big
  • RTX 5060Too big
  • RTX 3070Too big
  • RTX 3080 10 GBToo big
  • Arc B580Just misses
  • RTX 4070Just misses
  • RTX 4070 SuperJust misses
  • RTX 5070Just misses

All machines: Muse Glimmer 30B VRAM requirements. Everything that runs here: what can the RTX 3060 12 GB run?

Other models that run on RTX 3060 12 GB

Questions

Can Muse Glimmer 30B run on RTX 3060 12 GB?

Muse Glimmer 30B at 4-bit needs 18.0 GB; the RTX 3060 12 GB can use 12.0 GB. The smallest machine we checked that runs it is the RTX 4000 SFF Ada.

Shown at the closest setup. Report VR-1LMP132, calculated Nov 22, 2026 from published specs, not benchmarked.