Skip to content

FLUX.2 [dev] on H100 SXM: VRAM, speed and fit

FLUX.2 [dev] at 16-bit runs on the H100 SXM, about 16 s per image.

Image generation · 1024 × 1024

Runs comfortably · on H100 SXM · 16-bit (BF16)

GPU memory
61.2 GB
of 80.0 GB
Time
16 s
per image

Where the memory goes

Model
60.0 GB
Working
432 MB
Overhead
819 MB
OS
0.0 GB
Free
18.8 GB
Memory
61.2 GB of 80.0 GB
Output
1024 × 1024 · 28 steps
Time
16 s per image
Running cost
$16/mo at home · $254/mo on a cloud A100 80GB

Validation: Validated

What FLUX.2 [dev] on H100 SXM was checked against
CheckTargetResultStatus
Fits in GPU memory80.0 GB usable61.2 GB neededPass
Headroom5% free18.8 GB free (23%)Pass
Time per imageunder 30 s16 sPass

Targets: an image in under 30 s, and 5% of memory left free. Calculated from published specs, not benchmarked.

The setup

Model
FLUX.2 [dev]
Parameters
32.2B
Precision
16-bit (BF16)
Output
1024 × 1024
Steps
28
Hardware
H100 SXM
GPU can use
80.0 GB of 80.0 GB

Running cost

At home
$16/mo
710 W at the wall, under $0.001 an image
Renting instead
$254/mo
A100 80GB at $2.09/h, $0.03 an image

4 h a day, power at $0.18 per kWh, cloud at RunPod on-demand prices as of Nov 21, 2026.

Where to get it

FLUX.2 [dev] on similar machines

  • A100 80 GB SXMRuns

All machines: FLUX.2 [dev] VRAM requirements. Everything that runs here: what can the H100 SXM run?

Other models that run on H100 SXM

Questions

Can FLUX.2 [dev] run on H100 SXM?

FLUX.2 [dev] at 16-bit runs on the H100 SXM, about 16 s per image.

Report VR-0W1F5OK, calculated Nov 22, 2026 from published specs, not benchmarked.