There are people that are going to be mad at something you're doing or have done regardless. He spoke on it, its over. Those that continue to not like him will keep not liking him and he'll move on.