These are all great points but I'd also point out that the 'dark age' scenario is a highly competitive scenario, while the 'golden age' scenario is a highly collaborative one.
I don't think technology will fizzle out in either scenario. In the 'dark age' highly competitive scenario, you will still have those who 'understand what is produced' seeking progress and advancement. They will cohort with whoever/whichever organization is producing the best, most validated results.
I don't think knowledge would be become alien to human understanding, it would just become highly concentrated again as it was in the past. In the past, only the wealthy and noble could afford to spend time on education.
And usually, those who went deep into any field and provided contributions to science were those who had time to devote entire lives to the study or pursuit of knowledge. We still have these issues today, and these issues will always be present.
There is a supply chain of economy, and we provide different rewards based on the value of what is produced. The jobs never go away, the desire for prestige, greed, etc., never goes away. It's why economies exist, and it's why everyone is considering the value of LLMs, and their place in economies, and academies (presumably which exist to advance human understanding/appreciation, but also to prepare younger generations for future work).
I don't think technology will fizzle out in either scenario. In the 'dark age' highly competitive scenario, you will still have those who 'understand what is produced' seeking progress and advancement. They will cohort with whoever/whichever organization is producing the best, most validated results.
I don't think knowledge would be become alien to human understanding, it would just become highly concentrated again as it was in the past. In the past, only the wealthy and noble could afford to spend time on education.
And usually, those who went deep into any field and provided contributions to science were those who had time to devote entire lives to the study or pursuit of knowledge. We still have these issues today, and these issues will always be present.
There is a supply chain of economy, and we provide different rewards based on the value of what is produced. The jobs never go away, the desire for prestige, greed, etc., never goes away. It's why economies exist, and it's why everyone is considering the value of LLMs, and their place in economies, and academies (presumably which exist to advance human understanding/appreciation, but also to prepare younger generations for future work).