Comment Comment by epolanski Chinese papers and techniques have been very influential and copied by US labs.Multi-head Latent Attention (MLA), Multi-Token prediction, MoE architecture are some of the most famous examples. parent epolanski 4 months ago
Multi-head Latent Attention (MLA), Multi-Token prediction, MoE architecture are some of the most famous examples.