- does the company provide the harness and specific model for this? Or the interviewee use whatever they have access to? If they don't do a good job, is it the fault of the harness or the model or the interviewee not knowing how to fully utilise the harness and model or alternative harnesses and models?
- if every interviewee uses different harnesses and models, how does the company ensure that it's a fair comparison between interviewees for the same role?
- will the interviewer go through all lines in the code generated or let AI do it?
- does the company provide the harness and specific model for this? Or the interviewee use whatever they have access to? If they don't do a good job, is it the fault of the harness or the model or the interviewee not knowing how to fully utilise the harness and model or alternative harnesses and models?
- if every interviewee uses different harnesses and models, how does the company ensure that it's a fair comparison between interviewees for the same role?
- will the interviewer go through all lines in the code generated or let AI do it?