manifest

Smart LLM Routing for OpenClaw. Cut Costs up to 70% 🦞🦚

Visit WebsiteView on GitHub
4.1k
Stars
+343
Stars/month
10
Releases (6m)

Overview

Manifest is an intelligent model routing system designed for the OpenClaw ecosystem that automatically optimizes LLM costs by directing requests to the most cost-effective models. It acts as a middleware layer between your agent and various LLM providers, analyzing each request to determine the appropriate model based on complexity and requirements. Simple queries are routed to fast, inexpensive models while complex problems are handled by more capable but expensive models. The system includes automatic fallback mechanisms to ensure reliability when models fail, and provides usage monitoring with customizable alerts when spending thresholds are exceeded. With over 4,000 GitHub stars, Manifest offers both cloud-hosted and self-hosted deployment options, making it accessible for different infrastructure preferences and privacy requirements.

Pros

  • + Significant cost reduction potential of up to 70% through intelligent model routing based on request complexity
  • + Automatic failover system ensures high reliability by seamlessly switching to alternative models when primary ones fail
  • + Flexible deployment options with both cloud-managed service and local self-hosted installation available

Cons

  • - Limited to the OpenClaw ecosystem, which may restrict compatibility with other AI agent frameworks
  • - Requires additional infrastructure setup and configuration compared to direct LLM provider integration

Use Cases

Getting Started

Install the manifest-provider plugin using 'openclaw plugins install manifest-provider', configure authentication by running 'openclaw providers setup manifest-provider' with your API key from app.manifest.build, then restart the gateway with 'openclaw gateway restart' to enable the 'manifest/auto' model