Laminar logo

Laminar Alternatives for LLM Tracing and Evaluation

Observability · 8 alternatives ranked of 36 in the category

Explore tracing, evaluation, routing and training tools for different jobs. Capabilities overlap; check each source for your requirements.

Langfuse logo
Langfuse

Observability· langfuse.com

Freemium

Open-source LLM engineering platform for tracing, evals, prompt management, and metrics so teams can debug and improve production AI applications.

37,405
Open source
DeepEval logo
DeepEval

Observability· deepeval.com

Open source

Open-source evaluation framework for testing LLM apps, agents, RAG systems, and prompts with repeatable metrics, regression checks, and CI-friendly workflows.

19,474
Open source
MLflow logo
MLflow

Observability· mlflow.org

Open source

MLflow is an open-source AI engineering platform with GenAI evaluation, tracing, monitoring, and optimization workflows for agents, LLM apps, and models.

28,876
Open source
OpenPipe ART logo
OpenPipe ART

Observability· art.openpipe.ai

Open source

Agent Reinforcement Trainer for improving LLM agent reliability with GRPO-based reinforcement learning workflows.

10,867
Open source
Opik logo
Opik

Observability· comet.com

Open source

Open-source LLM observability and evaluation platform from Comet for tracing, prompt management, testing, and agent optimization.

23,400
Open source
Phoenix logo
Phoenix

Observability· arize.com

Open source

Open source AI observability and evaluation platform for tracing LLM applications, running evals, and debugging agent behavior with OpenTelemetry.

12,280
Open source
Portkey logo
Portkey

Observability· portkey.ai

Freemium

AI gateway and observability layer for routing, guardrails, caching, logging, and spend control across LLM providers behind one API.

13,377
Open source
Promptfoo logo
Promptfoo

Observability· promptfoo.dev

Open source

Open-source testing, red-teaming, and evaluation framework for prompts, RAG, and agents.

27,261
Open source

Choose by task

These examples describe tasks documented by each provider, not exclusive capabilities or a quality ranking. Check the sources and current terms before choosing.

  1. 1

    Langfuse

    Link prompt versions to traces and compare latency, cost and scores by version.

    Provider documentation
  2. 2

    DeepEval

    Run evaluation test cases and metrics for agents, RAG and output regressions in development or CI.

    Provider documentation
  3. 3

    MLflow

    Track machine-learning runs, parameters and artifacts.

    Provider documentation
  4. 4

    OpenPipe ART

    Train multi-step agents with reinforcement learning using GRPO; this is a training workflow.

    Provider documentation
  5. 5

    Opik

    Evaluate agent tasks against datasets using chosen metrics and trace the application.

    Provider documentation
  6. 6

    Phoenix

    Explore tracing and evaluation with OpenTelemetry and OpenInference instrumentation.

    Provider documentation
  7. 7

    Portkey

    Explore an AI gateway for routing and controls across model providers.

    Provider documentation
  8. 8

    Promptfoo

    Evaluate AI applications and run adversarial red-team tests.

    Provider documentation