Show HN: All you need is Prometheus and Jaeger for LLM Observability
2 by patcher99 | 0 comments on Hacker News.
Hey folks! I'm thrilled to let you all know about something my friend and I have been working on at [OpenLIT]( https://ift.tt/zix9EgY )! For those of you working with LLMs, we’ve got some pretty cool updates. We’ve successfully integrated Prometheus and Jaeger—yes, the go-to observability tools to fully support your LLM application observability. This means you can stick with the tools you already know and trust! Here's how it works: Imagine spending less time on setup and more on what truly matters: enhancing features and functionality. OpenLIT simplifies the process of adding observability to your LLM applications through OpenTelemetry (OTel). Just a single line of code and you can start monitoring key attributes like costs, token usage, user interactions, and performance metrics. And it doesn't stop at Prometheus and Jaeger! OpenLIT is also compatible with other backends like Grafana Tempo, or any OTel-compatible system, giving you the flexibility to store and visualize data just the way you like it. Head over to our guide to get started. Oh, and we've set you up with a Grafana dashboard that's pretty much plug-and-play. You're going to love the visibility it offers. We're super keen to see how OpenLIT integrates into what you’re doing! Give it a go and share your thoughts. Your feedback is super valuable and will help us make OpenLIT even better. Swing by and star our project on GitHub here -> https://ift.tt/zix9EgY Can’t wait to see OpenLIT in action in your LLM applications! Cheers! Patcher
No comments:
Post a Comment