Comment by nullc

Anyone ever look at doing a MoE like composition with RWKV and a transformer?