RICE (US) — The operator of a Twitter-like social media site in China tracks individual users and key topics, managing to delete 90 percent of offending posts within 24 hours, new research shows.
“Other people have explored censorship on Weibo, but this work is focused on the speed at which censorship happens,” says lead researcher Dan Wallach, professor of computer science at Rice University and co-author of the forthcoming study.
A team led by Wallach and University of New Mexico’s Jed Crandall worked with the study’s lead author, an independent researcher named Tao Zhu. Their analysis indicates that Sina Weibo uses a combination of keyword-matching software and human censors to monitor and delete potentially controversial posts on Weibo.
By closely monitoring individuals who frequently post controversial messages, Sina Weibo is able to delete many objectionable posts in less than five minutes, the study finds.
Launched three years ago, Weibo, like Twitter, allows users to post 140-character messages with usernames and hashtags. About 300 million people use Weibo, which is China’s most popular microblogging service.
For the study, researchers began by following 25 “sensitive” users that they had discovered by doing a search for people who had used words previously banned by Weibo. To broaden their search, the researchers added more than 3,000 users who had reposted one of the 25 sensitive users more than five times.
They then followed this expanded group for a period of time and measured how often and how quickly their posts were deleted. Any user with more than five deleted posts was added to the pool of sensitive users.
After 15 days, the sensitive group included 3,567 users. The researchers found that on average, about 4,500 posts by the sensitive users were deleted each day, including about 1,500 that were deleted at the network level by Sina Weibo.
The team’s censorship-tracking software was able to track, within one minute, the amount of time a post remained online before it was deleted.
The researchers found that deletions happened most heavily in the first hour after an original post had been made, and nearly 90 percent of deletions occurred within 24 hours. The analysis also revealed a sophisticated mechanism to remove all reposts of deleted posts, often within five minutes of the original post’s deletion. Deletion times were found to be significantly shorter for a subset of users who tended to post deleted content most often, an indication that Sina Weibo actively monitors the activity of some users.
“Roughly 12 percent of the total posts from our sensitive users were eventually deleted,” Wallach says. “We have enough of these posts to be able to run topical analysis algorithms that let us extract the main subjects that Weibo’s censors seemed concerned with on any given day.”
To date, researchers have collected 470 million posts from the Weibo public timeline and 2.38 million posts from a user timeline.
“Measuring how censorship is practiced by Weibo allows us to examine industry practices that may become more widespread,” says Crandall, assistant professor of computer science at University of New Mexico.
“There has been considerable debate in the US recently about extending copyright law enforcement to include various kinds of filtering online. China already has laws in place for companies within China to filter online content.”
Wallach and Crandall say that Weibo, as one of China’s largest social networking companies, faces the dual challenge of keeping its users engaged—and thereby watching advertisements and making money for Weibo—while keeping the content it hosts compliant with local laws.
“Weibo gives us a window into the future for what Internet censorship of social media around the world may look like,” Wallach says.
“Former Supreme Court Justice Louis Brandeis championed transparency a century ago when he wrote, ‘Sunlight is said to be the best of disinfectants.’ We hope that our research shines a light on how laws created by governments and implemented by the private sector can affect free speech everywhere, including here in the US.”
Source: Rice University