
Letta: The memory-augmented LLM agent framework (Apache 2.0, 14k stars)
The memory-augmented LLM agent framework — giving LLMs persistent memory with virtual context management and tiered storage.
Explore our latest articles and technical deep dives.

The memory-augmented LLM agent framework — giving LLMs persistent memory with virtual context management and tiered storage.

A memory layer for AI applications providing persistent, self-updating memory for LLMs with entity extraction and retrieval.

The most popular ChatGPT alternative UI — a lightweight, self-hosted chat interface supporting GPT, Claude, Gemini, and local models.

BentoML's LLM serving platform — one-command deployment of any open-source LLM with OpenAI-compatible API.

Adding AI-powered search to your existing Postgres database with no separate infrastructure — a PostgreSQL extension for vector similarity search.

A generative AI knowledge assistant that chats with your documents, images, and databases — your second brain in the cloud.

A scalable model serving library built on Ray for distributed inference with autoscaling, batching, and multi-model pipelines.

Combining project management with AI agents for automated task assignment and workflow orchestration — an AI-native task management platform.

Deploying LLM inference at scale with continuous batching, tensor parallelism, and flash attention — Hugging Face's production-grade inference server.