Comment Comment by pico_creator There is work done for Vision RWKV, and audio RWKV, an example paper is here: https://arxiv.org/abs/2403.02308Its the same principle as open transformer models where an adapter is used to generate the embeddingHowever currently the core team focus is in scaling the core text model, as this would be the key performance driver, before adapting multi-modal.The tech is there, the base model needs to be better parent pico_creator 1 year ago
Its the same principle as open transformer models where an adapter is used to generate the embedding
However currently the core team focus is in scaling the core text model, as this would be the key performance driver, before adapting multi-modal.
The tech is there, the base model needs to be better