That being said the freedom of (non-)association is one of the few non-violent means to signal your disapproval of someone else in a way that actually matters. The fact that folks are insulated from the consequences of their actions I think is a big part of how we got here. People spew hateful nonsense and sling accusations at each other that in person would get their teeth knocked out. Refusing to work with or collaborate with someone you consider to be distasteful is pretty mild and not terribly unreasonable even if it makes things awkward.
I can't exactly blame someone for acting on their conscience even if I don't like it. Working with someone who are at odds with despite your differences I consider praiseworthy but obligatory.