←back to thread

LLM Observability in the Wild – Why OpenTelemetry Should Be the Standard

(signoz.io)
144 points pranay01 | 4 comments | 27 Sep 25 18:56 UTC | HN request time: 0s | source
Show context
CuriouslyC ◴[27 Sep 25 19:37 UTC] No.45398725[source]▶
A full observability stack is just a docker compose away: Otel + Phoenix + Clickhouse and off to the races. No excuse not to do it.
replies(3): >>45398832 #>>45399127 #>>45399917 #
1. dcreater ◴[27 Sep 25 22:32 UTC] No.45399917[source]▶
Is phoenix really the no-brainer go to? There are so many choices - langfuse, w&b etc.
replies(2): >>45400143 #>>45402284 #
2. CuriouslyC ◴[27 Sep 25 23:12 UTC] No.45400143[source]▶
I suppose it depends on the way you approach your work. It's designed with an experimental mindset so it makes it very easy to keep stuff organized, separate, and integrate with the rest of my experimental stack.

If you come from an ops background, other tools like SigNoz or LangFuse might feel more natural, I guess it's just a matter of perspective.

3. jkisiel ◴[28 Sep 25 06:54 UTC] No.45402284[source]▶
Working at a small startup, I evaluated numerous solutions for our LLM observability stack. That was early this year (IIRC Langfuse was not open source then) and Phoenix was the only solution that worked out of the box and seemed to have the right 'mindset', i.e. using Otel and integrating with Python and JS/Langchain. Wasted lots of time with others, some solutions did not even boot.
replies(1): >>45403147 #
4. dcreater ◴[28 Sep 25 10:03 UTC] No.45403147[source]▶
This is exactly what I was looking for! An actual practitioners experience from trials! Thanks.

Is it fair to assume you are happy with it?