nirga

I think both the iPhone itself and things like AirPods form recent years are truly innovative so I wouldn’t say that

Hey! We don’t support an otel collector directly - you have to connect it to some backend. Minimal one can be jaeger for example

Sorry didn’t know that. It’s not my article so didn’t want to attribute the title to myself

For example - the fact that the FE environment variables are hardcoded at build time makes it hard to just deploy a container

I think that's the key benefit of using OpenTelemetry - it's pretty efficient and the performance footprint is negligible.

Thanks for spotting those! We'll fix it asap

I think you can (pretty) easily set this up with an otel collector and something that replays data from S3 - there's a native implementation that converts otel to clickhouse

You can do it and it's a good way of doing that - from our experiments that can catch most errors. You don't even need to use different models - even using the same model (I don't mean asking "are you sure?" - just re-running the same workflow) will give you nice results. The only problem is that it's super expensive to run it on all your traces so I wouldn't recommend that as a monitoring tool.

Thanks! It can vary greatly between use cases - but we've seen extremely high detection rates for tagged texts (>95%). When switching to production, this gets trickier since you don't know what you don't know (so it's hard to tell how many "bad examples" we're missing). Our false positive rate (number of examples that were tagged as bad but weren't) has been around 2-3% out of the overall examples tagged as bad (positive) and we always work on decreasing this.