TBH, I don't see anything wrong with 'go to', there's nothing missing from it as there is in the other examples (go and get, go to see, go to visit etc).
OTOH
"This is the solution we should go to in order to solve the problem" "This is the 'go to' solution"
Neither of these sentences are very pretty, but I can't see that they are incorrect.
I agree about the other examples.
Whatever happened to polo necks?
I'd love to have a cat.......but there is a problem


