core

AI agent microservice

Visit WebsiteView on GitHub
3.0k
Stars
+250
Stars/month
0
Releases (6m)

Overview

Cheshire Cat AI is a comprehensive framework for building custom AI agents as microservices. It provides an API-first approach that makes it easy to add conversational capabilities to any application through WebSocket chat and REST API endpoints. The framework comes with built-in RAG (Retrieval Augmented Generation) capabilities using Qdrant vector database, allowing agents to work with custom knowledge bases. Its plugin architecture enables extensibility through Python-based plugins that can implement hooks for event handling and tools for function calling. The system supports any language model via LangChain integration and includes multiuser functionality with granular permissions that can integrate with existing identity providers. Cheshire Cat AI is fully containerized with Docker, making deployment straightforward. It features an intuitive admin panel for managing agents and includes conversational forms for structured interactions. The framework is designed for developers who need to rapidly prototype and deploy AI agents with enterprise-ready features like user management, custom tools, and event-driven architecture.

Pros

  • + Complete microservice architecture with WebSocket and REST API support makes integration seamless
  • + Built-in RAG with Qdrant vector database provides out-of-the-box knowledge management capabilities
  • + Extensive plugin system with hooks and tools allows deep customization of agent behavior

Cons

  • - Requires Docker knowledge and infrastructure for deployment and management
  • - Python-only plugin development may limit accessibility for teams using other languages
  • - Complexity of features may create a steep learning curve for simple chatbot use cases

Use Cases

Getting Started

Install Docker on your system, then run 'docker run --rm -it -p 1865:80 ghcr.io/cheshire-cat-ai/core:latest' to start the service. Access the admin interface at localhost:1865/admin to configure your agent and test the chat functionality. Explore the REST API documentation at localhost:1865/docs to understand integration options.