Aphrodite Engine

Featured

Large-scale LLM inference engine

⭐ 1,656

Stars

🍴 185

Forks

🐛 127

Issues

🕐 3d ago

Last commit

C++AGPL-3.0api-restcudainference-engineinferentiaintelloramachine-learningrocm

🐍 $ pip install aphrodite-engine

About Aphrodite Engine

Large-scale LLM inference engine

Language

C++

License

AGPL-3.0

Open-Source API Development Ecosystem • https://hoppscotch.io • Offline, On-Prem & Cloud • Web, Desktop & CLI • Open-Source Alternative to P