vllm-mlx

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon, with continuous batching.

Desktopfree

vllm-mlx is a free, open-source high-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon, with continuous batching. It's built for developers running local LLM inference on Apple Silicon, filling a gap most generic tools don't address directly.

Website

Full match profile

Behind the summary, Matchbox keeps a richer profile of vllm-mlx - the signals our matcher actually reads to decide when to surface it. It stays private; claim the listing to see and control it.

Problem & pain-point mapping
Who we surface it to (audience fit)
What it's a strong alternative to
Trust & credibility signals

Claim vllm-mlx to unlock →

Something wrong with this listing — dead link, not a real product, wrong info?

Try Matchbox with your own problem

Describe what is not working - we’ll show you whether vllm-mlx (or something else) actually fits.

Try a problem