I am following much the same dress pattern as Teetine, except that I do not play golf. I do Tai CHi and as my tutor is streaming classes once a week I am getting into my gym gear to do the class. I did the first one in ordinary clothe.
I like to think I dress stylishly, but never at the cost of wearing uncomfortable clothes, so all my ordinary clothes are comfortable to wear and I continue to wear them.
I only wear tracksuits and pyjamas in the daytime when I am ill. If I started wearing them now, I would begin to think I was ill, which is probably not a good idea.