llm-gateway
Zero-trust LLM gateway with identity-based access and semantic routing across providers
PlatformWebfreeglobal

llm-gateway is a zero-trust, OpenAI-compatible LLM gateway built on OpenZiti that routes requests across OpenAI, Anthropic, Ollama, vLLM, and other compatible backends with semantic routing and load balancing. It provides identity-based access, virtual API keys, and end-to-end encryption, aimed at organizations wanting zero-trust control over LLM traffic rather than relying on shared API keys.
Categories
AI infrastructurezero-trust networking
Something wrong with this listing — dead link, not a real product, wrong info?

