Comment by jerrygenser

Yes but you can use an llm to label data and then train a bert model which then costs a small fraction of time and money to run than the original llm.