A lot of now-developed countries had 100% domestic textile production 60-70 years ago and yet nobody went naked (OK not 0% obviously but very few). People owned fewer pieces of clothing overall, but everyone could still afford to be clothed.
If textile manufacturing became 100% local again, local wages would also rise by a similar amount. $400 wouldn't seem unaffordable for a sweater. Or the sweater would cost correspondingly less.
If textile manufacturing became 100% local again, local wages would also rise by a similar amount. $400 wouldn't seem unaffordable for a sweater. Or the sweater would cost correspondingly less.