What is the relative difficult of each required part in training GPT3/ChatGPT? E.g. where is OpenAI's moat, and how wide is it?
Is it in model design (now published), data set, engineering needed to train it, cost of hardware needed to train it, cost of HLRF on top of GPT3 to make ChatGPT?
Is it in model design (now published), data set, engineering needed to train it, cost of hardware needed to train it, cost of HLRF on top of GPT3 to make ChatGPT?