tokens&
BrowseFor enterprises
Submit an offer
tokens&

Find tools, check provider offers, save a build plan, and share your work when you’re ready.

For buildersFor enterprises

For builders

  • Product launches
  • Builder projects
  • Startup credits and perks
  • Agent Skills
  • Published agents
  • API and agent docs
  • Publish a project

For enterprises

  • Start free company workspace
  • Submit a tool, product, or perk

Community

  • Community
  • Newsletter
  • Events
Xin

© 2026 tokensand, LLC. All rights reserved.

  • Terms
  • Privacy
  • Security
  • Data Processing
  • Status
  1. Home
  2. Tools
  3. LLM Providers
  4. vLLM
vLLM logo

vLLM

LLM Providers · Open source

High-throughput open-source inference and serving engine for LLMs with OpenAI-compatible APIs and production deployment patterns.

Visit websiteDocs

Related tools

Explore products with related capabilities. Check their details for your use case.

Browse the category
llama.cpp logo
llama.cpp

LLM Providers· github.com

Open source

C and C++ runtime for local LLM inference, quantized model serving, and edge deployment workflows.

Evaluate for your team
Is this your company?Verify ownership · Add products · See activity
OverviewProduct evaluationResources

Product evaluation

Review vLLM for your team’s requirements before a technical pilot.

Commercial model

Open source

View vendor website

Listed pricing category. Confirm current rates, limits and enterprise contract terms with the vendor.

Implementation

API listed · Open source listed

DocumentationSource repository

Validate integration, deployment and operational requirements in your own environment.

Enterprise review

Security, data handling, support and contract terms require vendor confirmation. Linked sources do not establish certification or approval.

Resources

Documentation and setup for builders and coding agents.

Official siteDocumentationGitHub repository
Setup & agents

Quickstart

Preparing vLLM docs pack
Streaming

The product profile is ready. Official docs, README snippets, and the AI paste pack are loading in the background.

Follow, compare & product details

Community support for vLLM. Votes do not verify product usage.

Add projectEmbed badgeFor companies
133,590
25,221
Open source
OpenAI API logo
OpenAI API

LLM Providers· platform.openai.com

Freemium

Model APIs for assistants, embeddings, retrieval, and production AI apps.

API available
Aion 3.0 on OpenRouter logo
Aion 3.0 on OpenRouter

LLM Providers· openrouter.ai

Commercial

Aion Labs multi-model reasoning API available through OpenRouter with a 131,072-token context window and OpenAI-compatible vendor endpoints.

API available
KServe logo
KServe

LLM Providers· kserve.github.io

Open source

Kubernetes-native inference platform for serving predictive and generative AI models at scale.

6,192
1,779
Open source
Start building with vLLM
Python

Detected in linked setup sources

pip
pip install vllm
Docs:Official DocsGitHubWebsite