End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.
comfyui
debian
kokoro-fastapi
linux
llama-swap
llamacpp
llm
mcp-proxy
mcpjungle
ollama
open-webui
vllm
Updated 2025-10-31 00:34:49 +01:00