Lin Song

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authentication, lightweight stacks, optional HTTPS and NVIDIA GPU support. MIT licensed. Multi-arch: amd64, arm64.

ScribeCrate: open-source, self-hosted Whisper speech-to-text server powered by faster-whisper. OpenAI-compatible transcription and English translation APIs, speaker diarization, JSON/SRT/VTT output, SSE streaming, offline operation with cached models, and Docker deployment on CPU (amd64/arm64) or NVIDIA CUDA (amd64).

ScribeCrate Live: self-hosted real-time transcription server powered by WhisperLive and faster-whisper. WebSocket streaming for live audio and an OpenAI-compatible REST API for files. All Whisper models, VAD, and offline mode with cached models. Docker deployment on CPU (amd64/arm64) or NVIDIA GPU (CUDA, amd64).

SpeakCrate: self-hosted text-to-speech API powered by Kokoro. OpenAI-compatible speech endpoint, 50+ voices across 9 languages, streamed audio/SSE, six output formats, offline mode with cached models, and persistent model caching. Docker deployment on CPU (amd64/arm64) or NVIDIA GPU (CUDA, amd64).

ParseCrate: self-hosted document processing API powered by Docling and docling-serve. Converts PDF, DOCX, PPTX, HTML, and more to Markdown/JSON. Sync/async conversion, RAG chunking, optional web UI, offline mode with cached models, and persistent model caching. Docker deployment on CPU (amd64/arm64) or NVIDIA GPU (CUDA, amd64).

InferCrate: self-hosted local LLM server powered by Ollama. Secure by default with auto-generated Bearer token auth. Native Ollama API and an OpenAI-compatible /v1 API subset. First-start model pre-pull, NVIDIA GPU (CUDA) acceleration, and persistent model storage. Docker deployment on CPU (amd64/arm64) or CUDA (amd64).