bentoml/BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

https://github.com/bentoml/BentoML ↗

Category: General

★ 8.7k · forks 984 · watchers 80 · open issues 185

License: Apache-2.0 · Default: main · Topics: ai-inference, deep-learning, generative-ai, inference-platform, llm, llm-inference, llm-serving, llmops, machine-learning, ml-engineering, mlops, model-inference-service, model-serving, multimodal, python

github · ai-inference · 0 reviews · updated 21 days ago

Critics score

—

Audience score

—

Scores hidden until this repo has at least 5 reviews.

Wiki, Report & Thread

Wiki page · AI Report (premium) · Discussion thread

Your review

Recent reviews

No reviews yet. Sign in to be the first to review this repo.