I worry that if I write significant amounts of code in pyspark it will have fallen out of fashion in ten year's time and someone will end up either rewriting it or running an ancient, unmaintained version of pyspark forever just to keep my stuff working.
I'm much less worried about that happening to SQL scripts.
I'm much less worried about that happening to SQL scripts.