tokens&
BrowseFor enterprises
Submit an offer
tokens&

Find tools, check provider offers, save a build plan, and share your work when you’re ready.

For buildersFor enterprises

For builders

  • Product launches
  • Builder projects
  • Startup credits and perks
  • Agent Skills
  • Published agents
  • API and agent docs
  • Publish a project

For enterprises

  • Start free company workspace
  • Submit a tool, product, or perk

Community

  • Community
  • Newsletter
  • Events
Xin

© 2026 tokensand, LLC. All rights reserved.

  • Terms
  • Privacy
  • Security
  • Data Processing
  • Status
  1. Home
  2. Best Tools
  3. Best AI Observability Tools

Best AI Observability Tools

Monitor and debug your AI applications with the best observability platforms.

Langfuse logo
Langfuse

Observability· langfuse.com

Freemium

Open-source LLM engineering platform for tracing, evals, prompt management, and metrics so teams can debug and improve production AI applications.

Frequently Asked Questions

What are the best ai observability tools?

tokens& tracks ai observability tools with product fit, docs, pricing, alternatives, open source status, public proof, and adoption evidence where available.

How do we rank ai observability tools?

Catalog ordering uses available stars, reviews, funding, featured status, saves, adoption-event counts, and product metadata. Those event counts do not establish verified adoption or retention. AgentRank is a separate ranking with its own published methodology. Sponsored suggestions, when present, are labeled.

For adoption evidence, see AgentRank rankings and the published methodology.

36,853
Open source
MLflow logo
MLflow

Observability· mlflow.org

Open source

MLflow is an open-source AI engineering platform with GenAI evaluation, tracing, monitoring, and optimization workflows for agents, LLM apps, and models.

28,707
Open source
Promptfoo logo
Promptfoo

Observability· promptfoo.dev

Open source

Open-source testing, red-teaming, and evaluation framework for prompts, RAG, and agents.

26,809
Open source
Opik logo
Opik

Observability· comet.com

Open source

Open-source LLM observability and evaluation platform from Comet for tracing, prompt management, testing, and agent optimization.

23,129
Open source
Portkey logo
Portkey

Observability· portkey.ai

Freemium

AI gateway and observability layer for routing, guardrails, caching, logging, and spend control across LLM providers behind one API.

13,301
Open source
DeepEval logo
DeepEval

Observability· deepeval.com

Open source

Open-source evaluation framework for testing LLM apps, agents, RAG systems, and prompts with repeatable metrics, regression checks, and CI-friendly workflows.

19,261
Open source
Ragas logo
Ragas

Observability· ragas.io

Open source

Evaluation framework for testing RAG and LLM applications with metrics, synthetic test data, and CI-friendly quality checks.

16,247
Open source
OpenPipe ART logo
OpenPipe ART

Observability· art.openpipe.ai

Open source

Agent Reinforcement Trainer for improving LLM agent reliability with GRPO-based reinforcement learning workflows.

10,822
Open source
TensorZero logo
TensorZero

Observability· tensorzero.com

Open source

Open-source LLM application stack for observability, evaluations, prompt optimization, and controlled model gateway workflows.

11,707
Open source
Phoenix logo
Phoenix

Observability· arize.com

Open source

Open source AI observability and evaluation platform for tracing LLM applications, running evals, and debugging agent behavior with OpenTelemetry.

12,113
Open source
Evidently logo
Evidently

Observability· evidentlyai.com

Freemium

Open-source observability and evaluation framework for monitoring ML and LLM applications with tests and metrics.

8,045
Open source
Giskard logo
Giskard

Observability· giskard.ai

Freemium

Open-source evaluation and testing library for LLM agents, RAG systems, and AI risk checks.

5,945
Open source
AgentOps logo
AgentOps

Observability· agentops.ai

Freemium

Developer platform for tracing, debugging, and deploying AI agents with SDK-based observability, session replay, and framework integrations.

5,937
Open source
LangWatch logo
LangWatch

Observability· langwatch.ai

Freemium

The complete LLMOps platform for agent testing, evaluations, prompt management, and production observability across AI applications.

5,005
Open source
OpenLIT logo
OpenLIT

Observability· openlit.io

Freemium

OpenTelemetry-native AI engineering platform for LLM observability, evaluations, guardrails, and prompt operations.

2,905
Open source
Kiln logo
Kiln

Observability· kiln.tech

Open source

Open-source AI engineering workbench for model evaluation, dataset curation, fine-tuning, and app reliability workflows.

5,254
Open source
TruLens logo
TruLens

Observability· trulens.org

Open source

Open-source evaluation and tracking toolkit for measuring LLM app quality, feedback functions, and RAG behavior.

3,629
Open source
Helicone logo
Helicone

Observability· helicone.ai

Freemium

Open-source AI gateway and LLM observability platform for logging, tracing, routing, evaluation, caching, and cost monitoring across model providers and agent stacks.

6,251
Open source
Traceloop OpenLLMetry logo
Traceloop OpenLLMetry

Observability· traceloop.com

Open source

OpenTelemetry-based open-source instrumentation for tracing, monitoring, and debugging LLM applications across frameworks and providers.

7,521
Open source
Pydantic Logfire logo
Pydantic Logfire

Observability· logfire-us.pydantic.dev

Freemium

Observability platform for production Python, LLM, and agent systems from the Pydantic team.

4,537
Open source
Guardrails AI logo
Guardrails AI

Observability· guardrailsai.com

Freemium

LLM validation and guardrail framework for checking structured outputs, policy compliance, and production AI failure modes before release.

7,586
Open source
Laminar logo
Laminar

Observability· laminar.sh

Freemium

Open-source observability, tracing, and evaluation platform built for AI agents.

3,473
Open source
Inspect AI logo
Inspect AI

Observability· inspect.aisi.org.uk

Open source

Framework for large language model evaluations, task definitions, solvers, scoring, and reproducible eval runs.

3,192
Open source
Future AGI logo
Future AGI

Observability· futureagi.com

Freemium

Open-source agent engineering platform that combines evaluations, observability, experiments, and guardrails so teams can ship and improve production AI agents faster.

2,241
Open source
Snyk Agent Scan logo
Snyk Agent Scan

Observability· github.com

Open source

Open-source Snyk scanner for AI agents, MCP servers, and agent skills that detects prompt injection, tool poisoning, toxic flows, and agent supply-chain risks.

3,176
Open source
MCPJam Inspector logo
MCPJam Inspector

Observability· mcpjam.com

Freemium

Testing and debugging workbench for MCP servers, MCP apps, and ChatGPT apps.

2,297
Open source
OpenInference logo
OpenInference

Observability· arize-ai.github.io

Open source

OpenTelemetry semantic conventions and instrumentation packages for tracing LLM calls, agent steps, tool use, and retrieval workloads.

1,302
Open source
AgentAcct logo
AgentAcct

Observability· github.com

Open source

Local-first work-intelligence dashboard for coding agents that attributes tokens, estimated cost, tasks, and verified evidence from local session logs.

756
Open source
Weights & Biases Weave logo
Weights & Biases Weave

Observability· wandb.ai

Open source

LLM observability and evaluation toolkit for tracing, debugging, and improving production agents and AI applications.

1,146
Open source
Scorable by Root Signals logo
Scorable by Root Signals

Observability· scorable.ai

Freemium

LLM and agent evaluation platform with reusable scorers, test datasets, and SDKs for measuring production AI behavior.

14
Open source
BoundFlow logo
BoundFlow

Observability· boundflow.github.io

Open source

Open-source control plane for governed AI agent execution with lifecycle policies, approvals, durable runs, audit receipts, and observability.

8
Open source
Braintrust logo
Braintrust

Observability· braintrustdata.com

Freemium

AI observability and evals platform for tracing production systems, running experiments, and catching regressions.

29
API available
mcpsnoop logo
mcpsnoop

Observability· github.com

Open source

Transparent MCP proxy and terminal inspector for observing tool calls, payloads, latency, and failures between clients and servers.

366
Open source
AnomalyArmor logo
AnomalyArmor

Observability· anomalyarmor.ai

Freemium

Data observability platform with hosted and local MCP access for alerts, freshness, schema drift, lineage, and quality checks.

1
Open source
Auralogs logo
Auralogs

Observability· auralogs.ai

Freemium

Agent-focused observability platform that exposes structured production logs and AI analyses to Codex, Claude, Cursor, and other clients through read-only MCP.

Open source
Alluvia logo
Alluvia

Observability· github.com

Open source

Local-first CLI that mines Claude Code, Cursor, and ChatGPT histories into searchable engineering insights without uploading conversations.

2
Open source