danielcampos93

mums the word on Flash?

I would love to know what the increased token count is across these models for the benchmarks. I find the models continue to get better but as they do their token usage also does. Aka is model doing better or reasoning for longer?

I think you would be very surprised by the number of customers who don't care if the embeddings are SOTA. For every Joe who wants to talk GraphRAG + MTEB + CMTEB and adaptive rag there are 50 who just want whatever IT/prodsec has approved

they also 10xed their revenue. 24 seems low for someone that pulled that off.

GPT-4o as a judge to evaluate the quality of something which gpt4o is not inherently that good at. Red flag.

does it do the full 100? In my experience anything around many items that needs to be exhaustive (all states, all fortune 100) tends to miss a few.

It's not free because it's cheap for them to run. It's free because they are burning that late-stage VC dollars. Despite what you might believe if you only follow them on twitter the biggest input to their product, aka a search index, is mostly based on brave/bing/serpAPI and those numbers are pretty tight. Big expectations for ads will determine what the company does.