Comment by 0atman

My go-to is "Alice has 3 brothers and also has 6 sisters. How many sisters does her brother have?". They all say 6!

This test is nice because, as it's numeric, you can vary it slightly and test it easily across multiple APIs.

I believe I first saw this prompt in that paper two years ago that tested many AI models and found them all wanting.