I can relate to that! And not just having the house to myself, but just being by myself, enjoying my own company.
When we were both working, DH worked on Saturdays and I didn't, so I was used to having that time to do as I pleased, sometimes going out window shopping, or walking with my camera in local parks/NT grounds. I used to love visiting other towns, to wander through markets and browse second hand bookshops.
Then we retired. And suddenly, if I wanted to go anywhere he wanted to come too. Or if he wanted to go anywhere he expected me to go too. So I didn't even get the house to myself. Ever. Because we are always either at home together or out together. I had to have a little talk with him, which turned into a big talk, which became quite a row. He just doesn't get it, thinks it's a personal insult that I want regular time to myself.
He does play golf most Saturdays now, though, so I can either please myself at home, or I get in the car and take myself off somewhere. At other times, I tend to quietly get ready - coat, shoes etc, then pick up my keys and tell him I'm popping out to wherever, not giving him a chance to say he'll come with me. Is that awful of me?
. But if I didn't get out by myself sometimes I would suffocate.