You seem like the complete opposite of a bad person to me. To have offered an apology after the incident was very mature of you and the self control you showed when he waved you away should be applauded. It seems you have dented his delicate male pride. He quite obviously has a very high opinion of himself. Probably thought he was ‘holding court’ with his wittiness in the restaurant then felt humiliated by your look of embarrassment. He sounds like a bully and not a very nice person. You have probably raised your daughter to be as lovely and tolerant as you so he gets away with this behaviour. The way she asked you not to go there is an indication that she would end up having a hard time too and wants to keep the peace. So he doesn’t do bedtimes. Really. Far too important it seems.
The problem is, whilst I would like to suggest you stick your fingers up his nostrils and make his eyes water, you are in such a difficult position. As the last thing you want is a family rift. If your DD is happy then continue to be the bigger person if you can. You’ve apologised, so let it drop now. Let him have his little sulk and superior moment that you bowed down to him. If he does decide to lecture you on your shortcomings, then if you can, say something like ‘Thank you for pointing that out to me ………… Now let’s leave it there’.
I can see problems in the future though with this buffoon. He is not a nice person.