← All articles · Dashboard
Models on disk
What the Dashboard's Models card shows — installed GGUF files, where they live, how much disk they use, and how to pull more.
3 min read
What it shows
The Models card on the Dashboard lists every GGUF file currently on disk in your Blueprint models directory:
- Display name + quant: e.g. "Qwen2.5 7B Instruct · Q4_K_M"
- File name of the actual .gguf
- Size on disk in human-readable bytes
When you're viewing a remote host (top-right host selector), the list is the GGUFs on that host's disk, not yours. The Pull-to-host button (see below) downloads onto the remote, not locally.
Where the files live
- Local:
~/.blueprint/models/(Linux/macOS),%USERPROFILE%\.blueprint\models\(Windows). - Remote:
~/.blueprint/models/on the remote host's home directory.
You can verify with your file manager or ls ~/.blueprint/models/.
Blueprint doesn't move files outside this directory; deleting one from
the file manager removes it from the Models card on next refresh.
How to add models
Locally
Use the Plan wizard to pick a model + quant, then Deploy → Pull
model. The kernel downloads the GGUF from HuggingFace and drops it
into ~/.blueprint/models/.
To a remote host
- Connect to the host via Hosts tab.
- Switch the host selector (top-right) to that host.
- Open Dashboard → Models. Click Pull to host.
- Pick a model + quant from the dropdown and click Pull. The download runs on the remote — you can disconnect and reconnect; it keeps going.
The progress row at the top of the card shows bytes downloaded / total / bytes-per-second. Pulls that fail (network drop, disk full) show a red banner with the error.
Resuming an interrupted download
The kernel writes to a .part file during download and renames to
.gguf only on success. If a download dies mid-way (network drop,
process kill), the next pull of the same model + quant resumes from
where it stopped — no need to start over.
If the partial file is corrupted or you want to force a fresh start,
delete the .part file manually from the models directory before
re-pulling.
Removing models
From the Maintain tab, the Delete model action removes the file from disk and updates the card. There's no undo — if you delete a 30GB model and change your mind, you'll need to re-pull.
Common pitfalls
- Disk full: GGUFs are large (Q4 of a 7B is ~4GB; Q4 of a 70B is ~40GB). The Models card sums total bytes — watch that against your free space, especially on remote hosts where you might not have a desktop file manager in front of you.
- Catalog ID vs file name mismatch: if you manually copied a GGUF
into the models directory, the parser tries to guess the catalog ID
from the filename. Names that don't match the pattern
<model-id>-<QUANT>.ggufmay show as the raw filename instead of the catalog display name. This is cosmetic — the model still loads. - Pull to host on a host without enough disk: the pull starts but fails partway with a disk-full error. Check disk space on the remote before starting big pulls; the Overview tab shows free disk under the system snapshot.
Need help with this in production?
Inspire AI Lab runs LLM optimization engagements end-to-end using Blueprint. If you'd rather hand the work to us instead of running it yourself, book a 30-minute review.