Comment by sahil_chaudhary

It is actually based on a different approach, it uses an image-captioning model finetuned on image-prompt pairs