OP here! This was a fun hackathon project we recently made stitching together the segment-anything-2 model with Google lens. You can click on items you see from instagram posts, youtube videos, or basically anything you see on the web, and it will try to find the most similar items for sale. If you want to change something, you can also chat with the extension to edit the color, brand, etc.
Note: the extension is not published live but sharing the code here!
Note: the extension is not published live but sharing the code here!