LLMKube
Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API
Categories
Platforms
License
Last Updated
October 22, 2026Current Release
Commit Activity
Related Applications
AI gateway written in Go with a unified OpenAI-compatible API for multiple LLM providers, USD cost...
Digital signage device and content management system with SMIL playlist support and scheduling
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models
User-friendly AI Interface, supports Ollama, OpenAI API
Run your AI models locally and generate images and audio
Chat UI that works with any LLM. It comes loaded with advanced features like agents, web search,...