Do you know why they left Google’s PaLM 0-shot and 1-shot results blank in the TriviaQA benchmarks? It’s not because Google didn’t release this data; they did in the same table as other data.
It’s because PaLM significantly outperforms them in both these cases and they can’t make their entire line bold to flaunt that it’s good.
I’m not trusting any of these benchmarks. A day or two of using the model I’d know if it’s better than GPT4 or not.
It’s because PaLM significantly outperforms them in both these cases and they can’t make their entire line bold to flaunt that it’s good.
I’m not trusting any of these benchmarks. A day or two of using the model I’d know if it’s better than GPT4 or not.