A friend of mine has just bought a 1950's house with a low front brick wall and when I visited I said, "Oh let's sit on the wall , it reminds me of being a kid." We use to sit on the front wall and chat for hours but it was usual one of our own walls. I think we use to sit on the wall by the bus stop. Sitting on walls was more the norm as people walked and used public transport and were out and about more.
One area I worked in they told me on a nice evening they would come out and sit on their walls and someone would make a tray of tea.
I would be a little disconcerted if someone sat on my wall, but not really sure why. If they were there for a while I might go out and ask them if they were OK. Don't even like people who are not visiting me, parking outside my house and that is totally unreasonable and I would never say anything. Must be territorial.