Octoroute

Smart HTTP router for local LLMs with health checks and load balancing

Servicefreeglobal

Octoroute is a Rust-native HTTP router for local LLMs such as Ollama, LM Studio and llama.cpp, combining rule-based and LLM-powered routing with health checks, load balancing and Prometheus metrics. It's built for people running more than one local model backend who want requests routed intelligently and reliably across them.

Website

Full match profile

Behind the summary, Matchbox keeps a richer profile of Octoroute - the signals our matcher actually reads to decide when to surface it. It stays private; claim the listing to see and control it.

Problem & pain-point mapping
Who we surface it to (audience fit)
What it's a strong alternative to
Trust & credibility signals

Claim Octoroute to unlock →

Something wrong with this listing — dead link, not a real product, wrong info?

Try Matchbox with your own problem

Describe what is not working - we’ll show you whether Octoroute (or something else) actually fits.

Try a problem