How much GPU memory does stable-diffusion-3.5-medium need?

About 36.6 GB to draw images: 32.59 GB of weights and the runtime's own memory (an estimate: its settings are behind its licence).

What is the cheapest GPU to run stable-diffusion-3.5-medium?

Right now one Nvidia A100 at $0.59 an hour; RTX PRO 6000 at $1.43 an hour is the best value for its speed. Prices are live offers from GPU clouds, checked every 15 minutes.

Can stable-diffusion-3.5-medium run on an RTX 4090?

Not on one: it needs about 36.6 GB and an RTX 4090 has 24 GB. Use a bigger GPU, or a smaller (quantized) version of the model.

Models / stable-diffusion-3.5-medium

stabilityai/stable-diffusion-3.5-medium

Text to image · served with Diffusers · ↓ 72.8K downloads a month · View on Hugging Face

stabilityai/stable-diffusion-3.5-medium needs about 36.6 GB of GPU memory to draw images (an estimate: its settings are behind its licence). It runs on one Nvidia A100 from $0.59/h right now; best value: RTX PRO 6000 at $1.43/h.

The model's publisher asks users to accept its licence (other). GridPup cannot download this one yet: choose an ungated version below.

Weights: 33 GB
GPU memory needed: about 36.6 GB (estimate)
Memory · disk: 47.1 GB · 76 GB
Architecture: StableDiffusion3Pipeline
Licence: other

Hardware and deploy

The publisher has not let GridPup download this licence-gated model yet. An ungated version of it (above) can be deployed.

Questions

How much GPU memory does stable-diffusion-3.5-medium need?: About 36.6 GB to draw images: 32.59 GB of weights and the runtime's own memory (an estimate: its settings are behind its licence).
What is the cheapest GPU to run stable-diffusion-3.5-medium?: Right now one Nvidia A100 at $0.59 an hour; RTX PRO 6000 at $1.43 an hour is the best value for its speed. Prices are live offers from GPU clouds, checked every 15 minutes.
Can stable-diffusion-3.5-medium run on an RTX 4090?: Not on one: it needs about 36.6 GB and an RTX 4090 has 24 GB. Use a bigger GPU, or a smaller (quantized) version of the model.

Loading…