open-source-ai• 15 min
BentoML: The unified model serving framework (Apache 2.0, 7k stars)
Deploying ML models as production APIs with auto-scaling and GPU management — BentoML unifies packaging, serving, and observability in one framework.
#bentoml#model-serving