mlc-ai/mlc-llm

Universal LLM Deployment Engine with ML Compilation

Category: AI / ML

★ 23.0k · forks 2.1k · watchers 194 · open issues 322

License: Apache-2.0 · Default: main · Topics: language-model, llm, machine-learning-compilation, tvm

github · language-model · 0 reviews · updated 4 months ago

Critics score

—

Audience score

—

Scores hidden until this repo has at least 5 reviews.

Wiki, Report & Thread