🏠

Run AI Models Locally

Set up a fully private AI stack on your own hardware. No data leaves your machine — ideal for sensitive data, air-gapped environments, or just saving on API costs.

Beginner3 layers · 8 tools
1

Model Runtime

Download and run open-source LLMs on your hardware

ollama166.6k

Simplest setup, one command to get started

llama.cpp100.3k

Maximum performance, supports CPU and GPU

vllm74.8k

Best throughput for GPU serving

2

Chat Interface

Web UI to interact with local models

open-webuifree129.4k

ChatGPT-like UI for Ollama

jan41.4k

Desktop app, works offline

lobehubfree74.5k

Feature-rich with plugin system

3

Fine-tuning

Customize models on your own data

unsloth58.7k

2x faster fine-tuning, 70% less memory

LlamaFactory69.3k

Unified fine-tuning for 100+ models

Compare Tools in This Blueprint

llama.cpp vs ollamajan vs open-webuiLlamaFactory vs unsloth

Build Your Own Blueprint

Describe your project and our AI will generate a custom blueprint with the best tool combinations for your needs.

Generate Blueprint