homehome Home chatchat Notifications


Twitter to release all tweets for scientists: massive scientific tool, but also an ethical dilemma

Five hundred million tweets are tweeted each day – with so many details about the location, interests and behaviors of users, the tweets are a trove of useful information for scientists who might be, for example, looking to find patterns in human behaviors, checking out risk factors for health conditions and track the spread of infectious […]

Mihai Andrei
May 27, 2014 @ 7:12 am

share Share

Five hundred million tweets are tweeted each day – with so many details about the location, interests and behaviors of users, the tweets are a trove of useful information for scientists who might be, for example, looking to find patterns in human behaviors, checking out risk factors for health conditions and track the spread of infectious diseases.

sss There are many potential uses to this information. By analyzing emotional cues in pregnant women, Microsoft researchers developed an algorithm that predicts those at risk for postpartum depression. The United States Geological Survey uses Twitter to track the location of earthquakes as people tweet about tremors. I could go on for days.

However, while all tweets are public, researchers wanting to access them have to do it through Twitter’s application programming interface, which currently only looks through 1 percent of the archive – drastically limiting the amount of available data. But all that is about to change.

Twitter announced that in February 2015, they will make all their tweets dating back to 2006 available for scientific research – with everything up for grabs, the usage of Twitter as a research tool will likely skyrocket. With so many data points to mine, it’s almost impossible to think of all the potential applications.

But this also raises some tough ethical questions: will Twitter claim any legal rights to any scientific findings? It seems somewhat understandable, and they could make a very strong case. But the most important question is: is it ethical to use the data of the people, without them giving consent? Again, on one hand, it’s very valuable data, and scientists could make good use of it, ultimately providing benefits to mankind. But on the other hand, maybe I just don’t want to reveal my data – I don’t feel comfortable with it. How could this be solved?

Caitlin Rivers and Bryan Lewis, computational epidemiologists at Virginia Tech, published guidelines for the ethical use of Twitter data in February. It seems like common sense, but I guess it needed to be written down. The gist of it is: never reveal personal information about users. Username, location, personal preference, whatever – that’s private, and you shouldn’t reveal personal information, just statistical information. Rivers and Lewis argue that it is crucial for scientists to consider and protect users’ privacy as Twitter-based research projects multiply. Well, as Spiderman said, with great data comes great responsibility! Or was that Snowden?

share Share

This 5,500-year-old Kish tablet is the oldest written document

Beer, goats, and grains: here's what the oldest document reveals.

A Huge, Lazy Black Hole Is Redefining the Early Universe

Astronomers using the James Webb Space Telescope have discovered a massive, dormant black hole from just 800 million years after the Big Bang.

Did Columbus Bring Syphilis to Europe? Ancient DNA Suggests So

A new study pinpoints the origin of the STD to South America.

The Magnetic North Pole Has Shifted Again. Here’s Why It Matters

The magnetic North pole is now closer to Siberia than it is to Canada, and scientists aren't sure why.

For better or worse, machine learning is shaping biology research

Machine learning tools can increase the pace of biology research and open the door to new research questions, but the benefits don’t come without risks.

This Babylonian Student's 4,000-Year-Old Math Blunder Is Still Relatable Today

More than memorializing a math mistake, stone tablets show just how advanced the Babylonians were in their time.

Sixty Years Ago, We Nearly Wiped Out Bed Bugs. Then, They Started Changing

Driven to the brink of extinction, bed bugs adapted—and now pesticides are almost useless against them.

LG’s $60,000 Transparent TV Is So Luxe It’s Practically Invisible

This TV screen vanishes at the push of a button.

Couple Finds Giant Teeth in Backyard Belonging to 13,000-year-old Mastodon

A New York couple stumble upon an ancient mastodon fossil beneath their lawn.

Worms and Dogs Thrive in Chernobyl’s Radioactive Zone — and Scientists are Intrigued

In the Chernobyl Exclusion Zone, worms show no genetic damage despite living in highly radioactive soil, and free-ranging dogs persist despite contamination.