My boyfriend and I broke up in June after dating for 6 years. I still hang out with his dad regularly since we both enjoy sporty activities like hiking, tennis, and biking; even though my ex and I don’t talk anymore. He hasn’t said anything about it yet, but I wouldn’t be surprised if he eventually did.
It seems the dad is your friend now. You don’t need your ex opinion about who you can be friend with.