<?xml version="1.0" encoding="utf-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
    <channel>
        <title>Blueprint Blog</title>
        <link>https://llmblueprint.ai/blog</link>
        <description>Technical deep-dives on LLM optimization from Inspire AI Lab.</description>
        <lastBuildDate>Fri, 26 Jun 2026 00:00:00 GMT</lastBuildDate>
        <docs>https://validator.w3.org/feed/docs/rss2.html</docs>
        <generator>https://github.com/jpmonette/feed</generator>
        <language>en</language>
        <copyright>© 2026 Inspire AI Lab LLC</copyright>
        <atom:link href="https://llmblueprint.ai/blog/rss.xml" rel="self" type="application/rss+xml"/>
        <item>
            <title><![CDATA[VRAM math for any open LLM, from 7B to 405B]]></title>
            <link>https://llmblueprint.ai/blog/vram-math</link>
            <guid isPermaLink="false">https://llmblueprint.ai/blog/vram-math</guid>
            <pubDate>Fri, 26 Jun 2026 00:00:00 GMT</pubDate>
            <description><![CDATA[Three numbers and one ratio tell you whether a model fits on a given GPU. Here's the formula, with worked examples for Llama-3.3, Qwen 2.5, and DeepSeek across every common quant level.]]></description>
            <author>Inspire AI Lab</author>
            <category>self-host</category>
        </item>
        <item>
            <title><![CDATA[Self-hosted vs API: the actual math at 1M / 10M / 100M tokens/month]]></title>
            <link>https://llmblueprint.ai/blog/selfhost-vs-api-math</link>
            <guid isPermaLink="false">https://llmblueprint.ai/blog/selfhost-vs-api-math</guid>
            <pubDate>Fri, 26 Jun 2026 00:00:00 GMT</pubDate>
            <description><![CDATA[API pricing is per-token and scales linearly. On-prem cost is mostly fixed. The crossover depends on usage, but it's lower than most people think. Here's the math at three usage tiers, with assumptions disclosed.]]></description>
            <author>Inspire AI Lab</author>
            <category>cost</category>
        </item>
        <item>
            <title><![CDATA[RAG vs fine-tuning vs both: a decision tree]]></title>
            <link>https://llmblueprint.ai/blog/rag-vs-fine-tuning</link>
            <guid isPermaLink="false">https://llmblueprint.ai/blog/rag-vs-fine-tuning</guid>
            <pubDate>Fri, 26 Jun 2026 00:00:00 GMT</pubDate>
            <description><![CDATA[RAG injects retrieved knowledge at inference time. Fine-tuning bakes it into the weights. Most production systems need some of each, and picking the wrong tool wastes engagement budget. Here's how we triage.]]></description>
            <author>Inspire AI Lab</author>
            <category>architecture</category>
        </item>
        <item>
            <title><![CDATA[QLoRA on a consumer GPU: fitting a 13B fine-tune in 24GB]]></title>
            <link>https://llmblueprint.ai/blog/qlora-on-consumer-gpu</link>
            <guid isPermaLink="false">https://llmblueprint.ai/blog/qlora-on-consumer-gpu</guid>
            <pubDate>Fri, 26 Jun 2026 00:00:00 GMT</pubDate>
            <description><![CDATA[You don't need an H100 to fine-tune a 13B model. With 4-bit base quantization, paged optimizer state, and gradient checkpointing, a 4090 will train one in an evening. Here's the recipe and the trap doors.]]></description>
            <author>Inspire AI Lab</author>
            <category>adaptation</category>
        </item>
        <item>
            <title><![CDATA[Prompt cache in production: what hits, what misses, and how to design around it]]></title>
            <link>https://llmblueprint.ai/blog/prompt-cache-production</link>
            <guid isPermaLink="false">https://llmblueprint.ai/blog/prompt-cache-production</guid>
            <pubDate>Fri, 26 Jun 2026 00:00:00 GMT</pubDate>
            <description><![CDATA[Most production LLM traffic shares a 1-4 kilo-token system prompt across every request. A prompt cache turns that shared prefix into a one-time cost — but only if your application sends the prefix the same way every time.]]></description>
            <author>Inspire AI Lab</author>
            <category>runtime</category>
        </item>
        <item>
            <title><![CDATA[Picking the right open model for your workload]]></title>
            <link>https://llmblueprint.ai/blog/picking-the-right-model</link>
            <guid isPermaLink="false">https://llmblueprint.ai/blog/picking-the-right-model</guid>
            <pubDate>Fri, 26 Jun 2026 00:00:00 GMT</pubDate>
            <description><![CDATA[There are eight open models worth considering in 2026. Picking the right one for your workload is mostly a function of three constraints: hardware, latency, and domain. Here's the decision matrix we use on engagements.]]></description>
            <author>Inspire AI Lab</author>
            <category>self-host</category>
        </item>
        <item>
            <title><![CDATA[LoRA from first principles: rank, alpha, and why low-rank works]]></title>
            <link>https://llmblueprint.ai/blog/lora-from-first-principles</link>
            <guid isPermaLink="false">https://llmblueprint.ai/blog/lora-from-first-principles</guid>
            <pubDate>Fri, 26 Jun 2026 00:00:00 GMT</pubDate>
            <description><![CDATA[LoRA freezes the base model and learns two small matrices whose product gets added to the original weights. That's the whole idea. Here's why it works, how to pick rank and alpha, and the failure modes we've hit on real engagements.]]></description>
            <author>Inspire AI Lab</author>
            <category>adaptation</category>
        </item>
        <item>
            <title><![CDATA[When llama.cpp beats vLLM (and vice versa)]]></title>
            <link>https://llmblueprint.ai/blog/llamacpp-vs-vllm</link>
            <guid isPermaLink="false">https://llmblueprint.ai/blog/llamacpp-vs-vllm</guid>
            <pubDate>Fri, 26 Jun 2026 00:00:00 GMT</pubDate>
            <description><![CDATA[Both can serve open LLMs. They have very different strengths, and picking the wrong one for your workload costs you both throughput and money. Here's the decision tree we use on engagements.]]></description>
            <author>Inspire AI Lab</author>
            <category>runtime</category>
        </item>
        <item>
            <title><![CDATA[What imatrix actually does (and why off-the-shelf Q4 leaves accuracy on the table)]]></title>
            <link>https://llmblueprint.ai/blog/imatrix-explained</link>
            <guid isPermaLink="false">https://llmblueprint.ai/blog/imatrix-explained</guid>
            <pubDate>Fri, 26 Jun 2026 00:00:00 GMT</pubDate>
            <description><![CDATA[Pre-quantized GGUFs from HuggingFace are calibrated against general web text. If your workload is anything else, you're paying an accuracy tax. imatrix lets you re-calibrate against your actual prompts — here's what changes and what to measure.]]></description>
            <author>Inspire AI Lab</author>
            <category>calibration</category>
        </item>
        <item>
            <title><![CDATA[Building an evaluation harness that survives prod]]></title>
            <link>https://llmblueprint.ai/blog/evaluation-harness</link>
            <guid isPermaLink="false">https://llmblueprint.ai/blog/evaluation-harness</guid>
            <pubDate>Fri, 26 Jun 2026 00:00:00 GMT</pubDate>
            <description><![CDATA[An eval set isn't 200 hand-picked test cases. It's a continuously-updated representation of what your users actually send, scored by metrics that correlate with what they actually want. Here's the harness shape we ship.]]></description>
            <author>Inspire AI Lab</author>
            <category>architecture</category>
        </item>
        <item>
            <title><![CDATA[Building a calibration corpus from your client's prompts]]></title>
            <link>https://llmblueprint.ai/blog/calibration-corpus</link>
            <guid isPermaLink="false">https://llmblueprint.ai/blog/calibration-corpus</guid>
            <pubDate>Fri, 26 Jun 2026 00:00:00 GMT</pubDate>
            <description><![CDATA[A custom imatrix is only as good as the calibration data behind it. Here's how we assemble a representative 2000-prompt corpus from a client's production logs without breaking PII rules or overfitting to the test set.]]></description>
            <author>Inspire AI Lab</author>
            <category>calibration</category>
        </item>
        <item>
            <title><![CDATA[Break-even analysis: when on-prem GPUs beat reserved cloud]]></title>
            <link>https://llmblueprint.ai/blog/break-even-on-prem-vs-cloud</link>
            <guid isPermaLink="false">https://llmblueprint.ai/blog/break-even-on-prem-vs-cloud</guid>
            <pubDate>Fri, 26 Jun 2026 00:00:00 GMT</pubDate>
            <description><![CDATA[Cloud GPU rental at $1.50-3/hr looks expensive on paper. Owning an H100 looks expensive on the invoice. The crossover depends on utilization more than anything else — here's the math, with caveats.]]></description>
            <author>Inspire AI Lab</author>
            <category>cost</category>
        </item>
    </channel>
</rss>