I don't think there is a small mom & pop one stop shop, but if you are willing to buy different things from different stores, you have options. I buy most of my electronics from B&H, and things like fasteners from McMaster-Carr.
Amazon does feel pretty unavoidable for the long tail, though.
Amazon does feel pretty unavoidable for the long tail, though.