Facebook is taking a more aggressive approach to shut down coordinated groups of real-user accounts engaging in certain harmful activities on its platform, using the same strategy its security teams take against campaigns using fake accounts.
The new approach uses the tactics usually taken by Facebook’s security teams for wholesale shutdowns of networks engaged in influence operations that use false accounts to manipulate public debate, such as Russian troll farms, Reuters said in an exclusive report.
It could have major implications for how the social media giant handles political and other coordinated movements breaking its rules, at a time when Facebook’s approach to abuses on its platforms is under heavy scrutiny from global lawmakers and civil society groups.
Facebook said it now plans to take this same network-level approach with groups of coordinated real accounts that systemically break its rules, through mass reporting, where many users falsely report a target’s content or account to get it shut down, or brigading, a type of online harassment where users might coordinate to target an individual through mass posts or comments.
The expansion, which a spokeswoman said, was in its early stages, means Facebook’s security teams could identify core movements driving such behavior and take more sweeping actions than the company removing posts or individual accounts as it otherwise might.
In April, BuzzFeed News published a leaked Facebook internal report about the company’s role in the January 6 riot on the US Capitol and its challenges in curbing the fast-growing ‘Stop the Steal’ movement, where one of the findings was Facebook had “little policy around coordinated authentic harm”.
Facebook’s security experts, who are separate from the company’s content moderators and handle threats from adversaries trying to evade its rules, started cracking down on influence operations using fake accounts in 2017, following the 2016 U.S. election in which U.S. intelligence officials concluded Russia had used social media platforms as part of a cyber-influence campaign — a claim Moscow has denied.
Can FB be as aggressive in shutting down coordinated harmful activities in every country that it operates in? This remains to be seen and evaluated.