Tag
Self-Hosted AI
2 posts tagged with Self-Hosted AI.
The Build Succeeded. The Numbers Were Garbage.
One question about a 30B model turned into rebuilding my home server's entire local-LLM stack. The hard part was learning to trust my own numbers.
Why I Built a Priority Queue for Ollama
Sixteen AI agents sharing one GPU. The GPU was fast enough. Ollama's FIFO queue wasn't. Here's how 620 lines of Node.js fixed it.