Xinference

Sydney, Australia · 11-50 employees · xinference.co

Xinference is an AI inference platform for private LLM deployment, model serving, and self-hosted AI. Run any model on your own infrastructure (managed cloud, private cloud, or on-premises) through a single OpenAI-compatible API. Customers report 40-70% lower inference costs than closed-source model APIs. Data sovereignty is built in. Model weights, inference traffic, and logs stay within your infrastructure. Zero data egress. RBAC, audit logs, and SSO/SAML included. NVIDIA-optimised, validated on H100, A100, and A10G. Xinference supports 300+ models across LLM, embedding, reranking, vision, and audio, including Qwen, DeepSeek, Kimi, and all major model families. Works with vLLM, SGLang, Transformers, MLX, and llama.cpp. Your existing OpenAI-compatible code works with a single base URL change. 9,300+ GitHub stars. Australian-owned. Trusted by teams in financial services, healthcare, and regulated industries across APAC and globally. Xagent is the no-code AI agent platform that turns plain-English descriptions into production-ready agents — connecting 200+ tools, any model, and deploying anywhere. Powered by Xinference. Follow us for product updates, technical guides, and practical insights on AI inference, LLM deployment, model serving, and enterprise AI infrastructure.