Headless means that you're using e-commerce platform only via API and build your front-end in whatever tech you want (next, nuxt, Remix, etc). It's different from a traditional approach when e-commerce platform handles front-end (HTML templates rendering). In Shopify can do both.
https://www.shopify.com/enterprise/headless-commerce