Yes, call a family meeting. You are involved anyway, so if he says that you are interfering ask him how you can have them in your house regularly for part of the week without being affected by the situation. You are picking up the pieces, so you would like to be in on the discussion. Add that you want to know what is going on, so that YOU can make YOUR plans, and not exist solely to sort out the mess that he has made.
Try to keep the discussion away from recriminations and concentrate on practical things. He probably knows your opinion of him by now, and as he has come clean about not loving your daughter any more, that is out in the open too.
Find out just what he means by "for the children" If he means for the benefit of the children, then he needs to come up with some solid plans of how he will achieve that, and stick to them. If he means for his benefit, so that he can enjoy the company of his children when he is in the mood, then he would be better off moving out and seeing them at regular previously agreed times.
I have a suspicion that professional help is going to be necessary to pin down this bloke to facing up to responsibility and considering other people as well as himself.