Ask HN: Is anybody building an alternative transformer?

Curious if anybody out there is trying to build a new model/architecture that would succeed the transformer?

I geek out on this subject in my spare time. Curious if anybody else is doing so and if you're willing to share ideas?