OpenLLMetry

OpenLLMetry

OpenLLMetry is an open-source observability framework built on OpenTelemetry, designed specifically for LLM applications.

FreeAPISDKCLIOpen sourceKorean
Visit websitetraceloop.com
Compare with book-to-skillExplore OpenLLMetry alternatives

Overview

OpenLLMetry is an open-source observability framework built on OpenTelemetry, designed specifically for LLM applications. It provides automatic tracing and monitoring for LLM providers, vector databases, and frameworks like LangChain. By integrating with existing observability stacks like Datadog or Honeycomb, it allows developers to debug complex LLM chains, track costs, and monitor performance with minimal code changes.

Key features

  • Automatic Tracing
  • OpenTelemetry Native
  • Cost & Token Tracking
  • Prompt/Response Logging
  • Vector DB Monitoring
  • Integration with Datadog/Honeycomb
  • Python & JS/TS Support

Pricing

FreeStarting price: Free (open source)
View pricing page

Verified on:

Use cases

  • Debugging LLM Apps
  • Cost Optimization
  • Latency Analysis
  • RAG Pipeline Monitoring

Who it is for

AI EngineersLLM DevelopersDevOps Engineers

Integrations

DatadogHoneycombNew RelicGrafanaSentry

Tags

MLOpsOpenTelemetry

How we verified this

Company, pricing, and feature details come from the primary sources below and our latest verification pass. When sources disagree, the official source and the most recent check win.

Last verified 08/30/2026Verified sources: 1

Alternatives

Tools you can use instead