Running Llama-3 Behind Your Own Firewall: a vLLM Production Checklist
GPU memory headroom, continuous batching, API-key rotation, and the monitoring you need before an internal LLM endpoint counts as production.
Long-form writing on technology, finance, and fitness.
Coming soon.
GPU memory headroom, continuous batching, API-key rotation, and the monitoring you need before an internal LLM endpoint counts as production.
Put one gateway between every app and every model — routing, budget caps, PII scrubbing, and audit logs in a single choke point.
Why a marketplace image that passed certification last month can be de-listed today, and the CVE-freshening pipeline that prevents it.
Per-vCPU, per-node, flat-tier: what actually clears procurement in enterprise accounts, with real marketplace data.
Committed-spend agreements expire whether you use them or not. A framework for routing real workloads at the burn-down.
Annual planning that survives contact with reality: capital allocation, partner programs, and when to say no to growth.
The minimum-effective-dose program that survives travel weeks, launch weeks, and everything in between.
Protein targets, meal timing around deep-work blocks, and what to keep out of the office entirely.