tool listing
vLLM
A serving engine for running open-weight models under load on your own GPUs, speaking an API most client libraries already understand.
- Site
- github.com/vllm-project/vllm
- Category
- inference
- Pricing
- free, open source (Apache-2.0)
- Last verified
- Wiki entry
- vLLM