🏠

Run AI Models Locally

Set up a fully private AI stack on your own hardware. No data leaves your machine — ideal for sensitive data, air-gapped environments, or just saving on API costs.

Beginner3 layers · 8 tools
1

Model Runtime

Download and run open-source LLMs on your hardware

ollama166.3k

Simplest setup, one command to get started

llama.cpp99.6k

Maximum performance, supports CPU and GPU

vllm74.5k

Best throughput for GPU serving

2

Chat Interface

Web UI to interact with local models

open-webuifree129.0k

ChatGPT-like UI for Ollama

jan41.3k

Desktop app, works offline

lobehubfree74.4k

Feature-rich with plugin system

3

Fine-tuning

Customize models on your own data

unsloth58.4k

2x faster fine-tuning, 70% less memory

LlamaFactory69.2k

Unified fine-tuning for 100+ models

Compare Tools in This Stack

llama.cpp vs ollamajan vs open-webuiLlamaFactory vs unsloth