Comment by broadsidepicnic

On what hardware do they run this? If I'll visit Shenzen, can I buy these chips? I'd much rather at this stage give money to any-other-manufacturer-than-Nvidia.

I have a use case where I have to run local models, can't share data offsite.