It was easy to misinterpret. My wife said/thought the exact same thing after watching the scene, because Joan's delivery was sort of weird, but she was saying "You're a jack-ass for trying to make me choose between my kid and you."