tokens&
For enterprises
Submit
Sign in
tokens&

Build better AI stacks, claim useful opportunities, and give AI infrastructure companies a source-labeled adoption readout they can trust.

For buildersFor enterprises

Product

  • Startup credits and perks
  • Agent Skills
  • Submit project, tool, product, or perk

Enterprise

  • Start free company workspace

Community

  • Community
  • Newsletter
  • Events
Xin

© 2026 tokensand, LLC. All rights reserved.

  • Terms
  • Privacy
  • Security
  • Data Processing
  • Status
  1. Home
  2. Alternatives
  3. Alternatives to LMCache
LMCache

Best Alternatives to LMCache

LLM Providers · 8 alternatives ranked of 14 in the category

Looking for alternatives to LMCache? These are the llm providers tools that score highest on adoption, reviews, benchmarks, and public code, with what separates each one from LMCache.

vLLM logo
vLLM

LLM Providers· docs.vllm.ai

Open source

High-throughput open-source inference and serving engine for LLMs with OpenAI-compatible APIs and production deployment patterns.

91,772
Open source

How each alternative differs from LMCache

Ranked by adoption, review, benchmark, and repository signals. Each note below is drawn from the two products’ own catalog records, so a product with nothing to separate it from LMCache carries no note.

  1. 1

    vLLM

    vLLM exposes a public API you can build against and carries 92k GitHub stars to LMCache's 12k.

  2. 2

    Replicate

    Replicate is not listed as open source, while LMCache is, is freemium against LMCache's open source model, and exposes a public API you can build against.

  3. 3

    Mistral AI

    Mistral AI is freemium against LMCache's open source model and exposes a public API you can build against.

  4. 4

    OpenAI API

    OpenAI API is not listed as open source, while LMCache is, is freemium against LMCache's open source model, and exposes a public API you can build against.

  5. 5

    llama.cpp

    llama.cpp exposes a public API you can build against and carries 128k GitHub stars to LMCache's 12k.

Frequently asked questions

What is the closest alternative to LMCache?

vLLM ranks highest among the alternatives to LMCache we track. vLLM exposes a public API you can build against and carries 92k GitHub stars to LMCache's 12k. High-throughput open-source inference and serving engine for LLMs with OpenAI-compatible APIs and production deployment patterns.

Which LMCache alternatives offer an API?

vLLM, Replicate, Mistral AI, OpenAI API, llama.cpp, Ollama, LiteLLM, and SGLang expose a public API. LMCache does not publish one in our catalog, so these are the options if you need to build against the product programmatically.

Replicate logo
Replicate

LLM Providers· replicate.com

Freemium

Cloud API and hosting platform for running, fine-tuning, and deploying open and custom AI models without managing GPU infrastructure.

598
API available
Mistral AI logo
Mistral AI

LLM Providers· mistral.ai

Freemium

Open and commercial model APIs for efficient inference.

Open source
OpenAI API logo
OpenAI API

LLM Providers· platform.openai.com

Freemium

Model APIs for assistants, embeddings, retrieval, and production AI apps.

API available
llama.cpp logo
llama.cpp

LLM Providers· github.com

Open source

C and C++ runtime for local LLM inference, quantized model serving, and edge deployment workflows.

128,373
Open source
Ollama logo
Ollama

LLM Providers· ollama.com

Open source

Local model runtime and API for downloading, running, and serving open LLMs on developer machines and private infrastructure.

175,565
Open source
LiteLLM logo
LiteLLM

LLM Providers· litellm.ai

Open source

Open-source LLM gateway and SDK that standardizes access to 100+ model providers with routing, logging, guardrails, and spend controls.

58,659
Open source
SGLang logo
SGLang

LLM Providers· docs.sglang.io

Open source

Fast open-source serving framework for LLM and vision-language model programs with structured generation and runtime optimization.

35,964
Open source
  • 6

    Ollama

    Ollama exposes a public API you can build against and carries 176k GitHub stars to LMCache's 12k.

  • 7

    LiteLLM

    LiteLLM exposes a public API you can build against and carries 59k GitHub stars to LMCache's 12k.

  • 8

    SGLang

    SGLang exposes a public API you can build against and carries 36k GitHub stars to LMCache's 12k.