open-source-ai• 15 min
Ray Serve: A scalable model serving library (Apache 2.0, 35k stars)
A scalable model serving library built on Ray for distributed inference with autoscaling, batching, and multi-model pipelines.
#ray-serve#ray
All Posts
Explore our latest articles and technical deep dives.
open-source-ai• 15 min
TaskingAI: An AI-native task management platform (Apache 2.0, 6k stars)
Combining project management with AI agents for automated task assignment and workflow orchestration — an AI-native task management platform.
#taskingai#task-management
open-source-ai• 15 min
Text Generation Inference: Hugging Face's production-grade LLM inference server (Apache 2.0, 9k stars)
Deploying LLM inference at scale with continuous batching, tensor parallelism, and flash attention — Hugging Face's production-grade inference server.
#tgi#huggingface
open-source-ai• 15 min
Triton Inference Server: NVIDIA's production inference server (BSD-3-Clause, 10.8k stars)
Supporting multiple frameworks, GPU optimization, and dynamic batching — NVIDIA's production inference server.
#triton#nvidia
open-source-ai• 15 min
Unstructured: The enterprise document preprocessing library (Apache 2.0, 9k stars)
Extracting and chunking text from PDFs, HTML, Word docs, and images for RAG pipelines — the enterprise document preprocessing library.
#unstructured#document-processing
open-source-ai• 15 min
XInference: A distributed LLM inference platform (Apache 2.0, 5k stars)
Supporting 100+ models with built-in embedding, reranking, and multi-GPU inference — XInference unifies inference engines under one OpenAI-compatible API.
#xinference#distributed
open-source-ai• 15 min
ActivePieces: An open-source automation platform (MIT, 12k stars)
An open-source automation platform with AI-powered workflow builder, pieces framework, and self-hosted deployment for enterprise automation.
#activepieces#automation
open-source-ai• 15 min
Danswer: An enterprise AI search and chat platform (MIT, 10k stars)
Connecting LLMs to your company documents, wikis, and knowledge bases with permission-aware retrieval — Danswer is the open-source enterprise search platform.
#danswer#enterprise-search
open-source-ai• 15 min
Lobe Chat: A modern AI chat framework (MIT, 50k stars)
A modern AI chat framework supporting multiple LLM providers, plugin system, TTS, vision, and a beautiful UI with multi-user management.
#lobe-chat#chat-framework