The funny thing is that Google will still let you store your home address and they'll display it on the map, but if you have Location History turned off they'll refuse to list it as an autocomplete option when you search for addresses or directions. They know what it is, but they won't let you actually use it unless you expose everything else. It's extremely user hostile and there's no good reason to do it.
They pin your saved locations to the top of the UI. If I click "Home" it will take me to my exact address. However, if I attempt to search "Home" in the search bar I get
"Turn on your Web & App Activity setting to search for 'home' and other personal places"
No thanks, Google. You don't need to know my entire location history 24/7 to take me to a static address you already have saved.
Edit: To clearly demonstrate what I'm talking about: https://imgur.com/a/QW9OxAS
They pin your saved locations to the top of the UI. If I click "Home" it will take me to my exact address. However, if I attempt to search "Home" in the search bar I get
"Turn on your Web & App Activity setting to search for 'home' and other personal places"
No thanks, Google. You don't need to know my entire location history 24/7 to take me to a static address you already have saved.