On most days, I don't have the opportunity to take an unexpected 15-20 minute pit stop in the middle of my day if I need to refuel the car.

I've never once had to do that in nearly 5 years of EV ownership (we are up to 3 EVs now in our family). Even for a few weeks when I was in a place without a home charger I didn't have to do it (unexpected and in middle of my day). That's because while I mostly optimize on efficiency (after all, I am engineer), I also optimize on price, so rather than running somewhere during the day ("peak") to charge, I would wait till nighttime to charge ("off peak"). Not only is it less expensive to charge at night, there are also fewer people charging, and less traffic, that's a win-win-win to me. About 2 or 3 years ago, for about a month and a half, a nearby supercharger was charging 11 cents/kWh, so once a week I would go there and charge for about 15 minutes, because 11 cents/kWh is less than the 15 cents/kWh that I pay at home! 😃

I assume you live in a condo or something similar to a condo. Soon, many condos will have chargers in their parking lots. I've recently looked at a bunch of condos, mostly newly constructed ones, or about to begin construction, and many of them mention "preparation for chargers in parking area".