← Back to match
llama-optimus
Automatically finds the best llama.cpp performance flags for your hardware
Desktopfreeglobal
llama-optimus is a free, open-source Python tool that automatically tunes llama.cpp's performance flags using Optuna, finding the settings that give the best tokens-per-second on a user's specific hardware. It's aimed at local LLM users running llama.cpp who don't want to manually trial-and-error dozens of performance flags.
Categories
AI toolsdeveloper toolsperformance optimization

