I mean, if he wants to be that specific, that's his right, but he needs to locate an official caretaker who will accommodate. I could understand saying he doesn't want them alone with the dude, but saying he can't be there all together is overstepping his bounds.