vLLM
Category: Local
| Detail | Value |
|---|---|
| Models | High-throughput LLM serving |
| Pricing | Free (open source) |
Overview
Open-source LLM serving engine for production deployments. PagedAttention for efficient memory management. Supports continuous batching for maximum throughput. The standard for self-hosted LLM inference at scale.