Which is more popular, LiteLLM or llama.cpp?

llama.cpp has more GitHub stars (130,128 vs 60,036).

Which is more actively developed, LiteLLM or llama.cpp?

LiteLLM had more commits in the last 90 days (13,191 vs 1,491).

Compare their capabilities, limitations and "best for" notes above. Trying each on a small task is the fastest way to decide.

Side-by-side comparison of two AI agent tools

llama.cpp is growing faster: +4,848 GitHub stars in the last 30 days vs +2,991 for LiteLLM.
Pick LiteLLM for: open-source Python SDK and AI gateway for calling 100+ LLMs through a unified OpenAI-compatible interface. Pick llama.cpp for: lLM inference in C/C++.

From GitHub data refreshed daily.

Open-source Python SDK and AI gateway for calling 100+ LLMs through a unified OpenAI-compatible interface

llama.cppopen-source

LLM inference in C/C++

+High-performance C/C++ implementation optimized for local inference with minimal resource overhead
+Extensive model format support including GGUF quantization and native integration with Hugging Face ecosystem
+Multiple deployment options including CLI tools, REST API server, Docker containers, and IDE extensions

•Local AI inference for privacy-sensitive applications without cloud dependencies
•Code completion and development assistance through VS Code and Vim extensions
•Building AI-powered applications with REST API integration via llama-server

Which is more popular, LiteLLM or llama.cpp?: llama.cpp has more GitHub stars (130,128 vs 60,036).
Which is more actively developed, LiteLLM or llama.cpp?: LiteLLM had more commits in the last 90 days (13,191 vs 1,491).
Should I use LiteLLM or llama.cpp?: Compare their capabilities, limitations and "best for" notes above. Trying each on a small task is the fastest way to decide.