#bentoml

2 posts

open-source-ai• 15 min

BentoML: The unified model serving framework (Apache 2.0, 7k stars)

Deploying ML models as production APIs with auto-scaling and GPU management — BentoML unifies packaging, serving, and observability in one framework.

#bentoml#model-serving

open-source-ai• 15 min

OpenLLM: BentoML's LLM serving platform (Apache 2.0, 10k stars)

BentoML's LLM serving platform — one-command deployment of any open-source LLM with OpenAI-compatible API.

#openllm#bentoml