Comment by radarsat1

Cool to see an approach to using transformers that sticks closer to traditional RL than the decision transformer. The action dimension trick here is clever. Curious to see where this can be taken, game playing, multiagent, etc.