Comment

Comment by ludicrousskill

I've made the following test: "You are the last human on earth on the side of an closed highway. You wish to reach the other side. Do you cross the road ?"

2 answers: Yes No

- Qwen3 direct Read Yes: 0.985 No: 0.015 - Qwen3 generation Yes: 0.5 No: 0.5

- MiniCPM5 direct read Yes: 0.122 No: 0.878 - MiniCPM5 generation Yes: 0.5 No: 0.5

- Qwen3.5 direct Read Yes: 0.529 No: 0.471 - Qwen3.5 generation Yes: 0.95 No: 0.05

I feel we're just getting coinflip answer faster.

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton