Can I get supervised visitation for husband living with someone with criminal past?

I have sole custody because of domestic violence - ex consented to sole. Ex-husband has unsupervised visitation every Friday 9-4, and every other Sat 2-6. Ex recently moved out of his home and stated to me and my lawyers that he was living with a family. PI discovered Ex not living there, but living with woman he had affair with and her husband. The three of them have "relations". Plus, her husband has a doent criminal past of drug, theft and battery charges. Domestic Commissioner denied TRO to prohibit him from taking my 2 year old to their residence - said wasn't enough evidence to warrent that she was in danger...can you believe that one! Lawyer and I are trying to get supervised visitation on him because daughter is in dangerous situation and he lied to court about his residence. Do you think we have a chance?