Comment by vladimirzaytsev

You may get way more accurate results from relatively small models as well as logits for each class if you ask one question per class instead.