It is strange that you couldn't find the empty web template. Every version of ASP.NET Core has come with one. Empty is the first option in the "Create a new ASP.NET Core web application" dialog in VS2019, and "dotnet new web" creates an empty website via the command line.
What did you need to do to create an empty website?
What did you need to do to create an empty website?
Disclaimer: I work on ASP.NET Core