open-source-ai• 15 min
GPT4All: Nomic AI's local LLM ecosystem (MIT, 72k stars)
Nomic AI's local LLM ecosystem running models on consumer hardware with CPU-only support, a Python API, and local RAG capabilities.
#gpt4all#nomic
All Posts
Explore our latest articles and technical deep dives.
open-source-ai• 15 min
Jan: A privacy-first desktop AI assistant (Apache 2.0, 43k stars)
A privacy-first desktop AI assistant running 100% offline with built-in model downloads, extensions, and a clean chat interface.
#jan#desktop
open-source-ai• 15 min
llama.cpp: The definitive LLM inference engine (MIT, 75k stars)
The definitive LLM inference engine — running quantized models on CPU and GPU with state-of-the-art performance via GGUF format.
#llamacpp#inference-engine
open-source-ai• 15 min
LlamaFile: Mozilla's single-file LLM runner (Apache 2.0, 20k stars)
Mozilla's single-file LLM runner distributing AI models as executable files that run on 6GB VRAM without installation.
#llamafile#mozilla
open-source-ai• 15 min
LM Studio: A desktop application for running local LLMs (MIT, 10k stars)
A desktop application for running local LLMs — with a built-in model browser, chat interface, and OpenAI-compatible local API server.
#lm-studio#desktop-app
open-source-ai• 15 min
LocalAI: A drop-in OpenAI API replacement (MIT, 28k stars)
A drop-in OpenAI API replacement running LLMs, image generation, audio transcription, and TTS entirely locally with no GPU required.
#localai#openai-replacement
open-source-ai• 15 min
Ollama: The easiest way to run LLMs locally (MIT, 120k stars)
The easiest way to run LLMs locally — one-command setup for 100k+ models with OpenAI-compatible API and GPU acceleration.
#ollama#local-llm
open-source-ai• 15 min
Text Generation WebUI: The most feature-rich local LLM interface (AGPL-3.0, 42k stars)
Supporting 20+ model loaders, LoRA, RLHF, multimodal models, and custom chat templates — the most feature-rich local LLM interface.
#text-generation-webui#oobabooga
open-source-ai• 15 min
Meta AudioCraft: Meta's audio generation toolkit (MIT, 21k stars)
Meta's audio generation toolkit for generating music, sound effects, and audio from text descriptions with MusicGen and AudioGen models.
#audiocraft#meta