open-source-ai• 15 min
AnythingLLM: The all-in-one AI desktop app (MIT, 30k stars)
Combining RAG, multi-model chat, document ingestion, and agent tools in a single Docker container with 30+ LLM providers in one app.
#anythingllm#all-in-one
Engineering Insights
Technical Deep Divesfor Modern Engineering
Explore AI engineering, system design, DevOps, and cutting-edge tools reshaping how we build software.
95
Articles published
5
Topic areas
Featured Series
AI Tools Mastery
An 18-part engineering deep dive into ChatGPT, Claude, Gemini, Perplexity, DeepSeek, Copilot, Grok, Lovable, Manus, NanoBanana, Leonardo AI, Meta AI, Assembly AI, Canva AI, Veo 3, Sora 2, Kimi, and Kling.
Browse the series →·18 posts·Code, architecture, cheat sheets & course-style deep dives
Latest Articles
Sorted by newest first
open-source-ai• 15 min
BentoML: The unified model serving framework (Apache 2.0, 7k stars)
Deploying ML models as production APIs with auto-scaling and GPU management — BentoML unifies packaging, serving, and observability in one framework.
#bentoml#model-serving
open-source-ai• 15 min
Docling: IBM's document understanding library (MIT, 5k stars)
Converting complex PDFs, tables, and multi-column layouts into structured Markdown for AI processing — all with a permissive MIT license.
#docling#ibm
open-source-ai• 15 min
Letta: The memory-augmented LLM agent framework (Apache 2.0, 14k stars)
The memory-augmented LLM agent framework — giving LLMs persistent memory with virtual context management and tiered storage.
#letta#memgpt
open-source-ai• 15 min
Mem0: A memory layer for AI applications (Apache 2.0, 25k stars)
A memory layer for AI applications providing persistent, self-updating memory for LLMs with entity extraction and retrieval.
#mem0#memory
open-source-ai• 15 min
NextChat: The most popular ChatGPT alternative UI (MIT, 78k stars)
The most popular ChatGPT alternative UI — a lightweight, self-hosted chat interface supporting GPT, Claude, Gemini, and local models.
#nextchat#chatgpt-alternative
open-source-ai• 15 min
OpenLLM: BentoML's LLM serving platform (Apache 2.0, 10k stars)
BentoML's LLM serving platform — one-command deployment of any open-source LLM with OpenAI-compatible API.
#openllm#bentoml
open-source-ai• 15 min
pgvector: A PostgreSQL extension for vector similarity search (MIT, 13k stars)
Adding AI-powered search to your existing Postgres database with no separate infrastructure — a PostgreSQL extension for vector similarity search.
#pgvector#postgresql
open-source-ai• 15 min
Quivr: Your second brain in the cloud (Apache 2.0, 36k stars)
A generative AI knowledge assistant that chats with your documents, images, and databases — your second brain in the cloud.
#quivr#knowledge-assistant