Regulating speech is difficult even under the best of conditions, and the internet is far from the best of conditions. Its patchwork system of regulation by private entities satisfies no one, yet it is likely to endure for the foreseeable future.
By way of explanation, consider a case in which authority is (mostly) centralized and the environment is (mostly) controlled: my own. I am a professor, and if a student regularly made offensive remarks in class, I would meet with that person and try to persuade them to desist. (For the record, this has never happened to me.) If the person continued, I would at some point seek to ban the student from my class, with the support of my university.
Yet this solution is not as straightforward as it seems. Maybe it’s good if you trust my judgment, but it is not readily scalable. It only works because such incidents are so rare. I can’t be effective in my job if I need to spend my time regulating and trying to modify the speech of my students.
And this approach becomes all the more unwieldy when adopted by internet platforms. Patreon is crowd-funding site that has vowed to persuade and reform its patron-seeking users who engage in what it considers offensive behaviour. If those users do not fall into line, as defined by the standards of Patreon, Patreon will ban them.
But outsiders (and some users) will never sufficiently trust the company’s judgment, whether Patreon has good judgment or not. Furthermore, the judgmental processes of the company are difficult to scale, because personal intervention is required in each case, and at some point the decisions will become bureaucratic. Over time, disputes over banned and non-banned users will distract Patreon from its core function of helping people raise money over the internet.
An alternative approach is simply to let anyone use the platform and not engage in much regulation of speech or users. A few years ago, private regulation was a much smaller issue than it is today, even if offensive material posted on Facebook or YouTube invariably prompted a takedown order. (Disclaimer: Facebook has been a donor to my university and research centre.)
The problem with these systems is that they were too hospitable to bad actors. The Russian government, for instance, used multiple internet platforms to try to sway the 2016 U.S. presidential election. I agree with Nate Silver that such efforts did not have significant influence over the final outcome, but that is not the point here. If platforms are perceived as hospitable to bad actors, including enemies of America and democracy, those platforms will start to lose their legitimacy in the eyes of both the public and its elected representatives.
An alternative approach is for platform companies to regulate by algorithm. For instance, if a posting refers to Nazis and uses derogatory terms for Jews, the algorithm could ban those postings automatically. That may work fine at first, but eventually the offensive posters will figure out how to game the algorithms. Then there is the issue of false positives — postings that the algorithm identifies as offensive but aren’t. The upshot is that human judgment will remain a crucial supplement to any algorithm, which will have to be fine-tuned regularly.
As these processes evolve, each internet platform will not be consistent or fair across its many users, as some will get away with being offensive or dangerous, while others may be censored or kicked off for insufficient reasons. Facebook recently has devoted a lot of resources to regulating speech on its platform. Yet undesired uses of the platform hardly have gone away, especially outside the U.S. Furthermore, the need for human judgment makes algorithms increasingly costly and hard to scale. As Facebook grows bigger and reaches across more regions and languages, it becomes harder to find the humans who can apply what Facebook considers to be the proper standards.
I’d like to suggest a simple trilemma. When it comes to private platforms and speech regulation, you can choose two of three: scalability, effectiveness and consistency. You cannot have all three. Furthermore, this trilemma suggests that we — whether as users, citizens or indeed managers of the platforms themselves — won’t ever be happy with how speech is regulated on the internet.