Comment by abeppu

Why do you expect an AI developed in the same economic system would optimize for your preferences rather than their revenue? I think this only works if people can run, fine-tune and update their own models -- otherwise the giant AI vendors have every incentive to nudge you towards whichever retailer is bidding most on your Sponsored Responses, right? I think the only difference will be that instead of advertising to target a query, they'll eventually need to target a vector and its neighborhood, and there will be some greater opacity facing advertisers trying to match "middle-income US users shopping for airfryers who have product height limits posed by kitchen upper cabinets" or something.