Comment by tagwall

for now, but both model makers and hardware developers will work to get you to use models which are good enough to run on their devices without any special GPU requirements