Comment by almostuseful

You have to start somewhere. But looped transformers https://sebastianraschka.com/llm-architecture-gallery/looped... are more similar to your idea.