New This Week

Go ahead and axolotl questions

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

The Security Toolkit for LLM Interactions

Developer APIs to Accelerate LLM Projects

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to

Open-source developer platform to power your entire infra and turn scripts into webhooks, workflows and UIs. Fastest workflow engine (13x vs Airflow). Open-source alternative to Retool and Temporal.

Temporal service

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

Python bindings for llama.cpp

Large Language Model Text Generation Inference

Universal LLM Deployment Engine with ML Compilation

A high-throughput and memory-efficient inference and serving engine for LLMs

A fast multimodal LLM for real-time voice

This project is deprecated. Check my new project ChatHub:

A Go implementation of the Model Context Protocol (MCP), enabling seamless integration between LLM applications and external data sources and tools.

The official Python SDK for Model Context Protocol servers and clients

The official TypeScript SDK for Model Context Protocol servers and clients

🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance m

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform ro

Supercharge Your LLM Application Evaluations 🚀

Large Action Model framework to develop AI Web Agents

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Ll

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Open-source vector similarity search for Postgres

☁️ Build multimodal AI applications with cloud-native stack

Jarvis AI Assistant - Voice-powered AI assistant for Mac

ImageBind One Embedding Space to Bind Them All

An Optimized Speech-to-Text Pipeline for the Whisper Model Supporting Multiple Inference Engine

🎙️🤖Create, Customize and Talk to your AI Character/Companion in Realtime (All in One Codebase!). Have a natural seamless conversation with AI everywhere (mobile, web and terminal) using LLM OpenAI G

DALL·E Mini - Generate images from a text prompt

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".

An open-source visual programming environment for battle-testing prompts to LLMs.

The LLM Evaluation Framework

LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR team.

Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.

LLM-powered multiagent persona simulation for imagination enhancement and business insights.

Generative Agents: Interactive Simulacra of Human Behavior

A MIT-licensed, deployable starter kit for building and customizing your own version of AI town - a virtual town where AI characters live, chat and socialize.

Hexabot is an open-source AI chatbot / agent builder. It allows you to create and manage multi-channel and multilingual chatbots / agents with ease.

This repository provides tutorials and implementations for various Generative AI Agent techniques, from basic to advanced. It serves as a comprehensive guide for building intelligent, interactive AI s

LlamaIndex is the leading document agent and OCR platform

A library for efficient similarity search and clustering of dense vectors.

Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone