Freedom of speech does not mean freedom from ramifications or ruffled feathers from what you say or how you choose to say it, whether one agrees with what was said or not. This family has a show on A&E. A&E is a private corporation as far as I know. Right, wrong, ridiculous, justified, or whatever, they have the right to air or suspend whatever from their network for whatever reason they like. I really don't look at it anymore than a business decision...and with any business decision there are both positive and negative consequences to the decision.
I say let the market decide. If people want to watch or boycott the show, let the people/viewers decide. If people want to watch or boycott A&E, let the people/viewers decide the fate. It isn't like there aren't other channels out there to watch. A&E will figure out what to do later if it hurts their bottom line and likewise for the Robertson Family.
As for the show itself, I would be shocked if the family does not stick together along the lines of, 'ban one of us and you ban us all" or something like that. The show is so enormously popular despite what was said, that I think other networks would be in line to pick them up should things not work out with A&E. Will it be popular on another network? Again, let the market/viewers decide.
On a different note, it bothers me a bit that this is such big news. No one would give a flip what he said if he wasn't on TV. I'd rather see more newsworthy stories--like the grossly under-reported issues of human trafficking (sex & labor) going on in the U.S., or how the government abuses its power every day and has been for decades, unnecessary excessive force from police, military benefits going down the toilet, etc.--a.k.a. real problems/issues. Or, maybe report on some feel good stories for this time of year of people helping other people/putting others first before themselves.
Just my opinion.