Using Twitter To Tap Into The Mood Of The Planet

Sep 29, 2011
Originally published on September 29, 2011 3:22 pm

Right now, armies of marketers, pollsters and social scientists are trying to figure out what Americans are thinking about — issues like global warming or Lady Gaga's latest outfit. Surveys are only so good: It's hard to get a big enough sample to be sure of the results. That's particularly vexing for social scientists who want a high standard of accuracy.

But now they have a new window on the world: Twitter. Normally, if social scientists wanted to design an experiment on how peoples' moods change during the course of a day, for example, they'd recruit some of their students. But statistically, what 50 college kids do doesn't really reflect the American public.

Scientists need lots of people to make solid conclusions about human behavior. That's why Scott Golder went to Twitter, where millions and millions of people express themselves daily.

"This is the stuff of daily life," Golder says. "Whether you're doing that with diaries from a few hundred years ago or you're doing it with the tweets of today, you're still looking into the personal lives of regular people, and that is very revealing."

What Golder and his colleagues at Cornell University wanted revealed is: How do peoples' moods go up and down — positive or negative — through the day? That might then reveal how much and when your biorhythms or your environment control the way you feel.

The researchers used a common computer program that scans text for key words in tweets that reflect the writer's mood, or, as psychologists call it, affect. These are words like aching, afraid, cynical, fear, mad and fury, Golder says. These words fall into the "negative" category.

On the positive side, Golder looked for words including agree, definitely, fine, outgoing, paradise and pleasing. And, of course, this being the Twitter generation: "Awesome. Awesome is an awesome word."

Golder, who's a graduate student in social and computer science, spent months with a team of researchers scanning tweets by more than 2 million people in 84 countries — more than a half-billion tweets.

"We found there are two peaks in positive affect during the day. One occurs first thing in the morning and one occurs late at night," he says.

Of course, you say, the dip in the middle is when you go to work. But Golder says no. "The shape of the rhythm — when it peaks and valleys — is the same on the weekend as during the week."

Golder doesn't know why mornings and evenings tend to be brighter than the rest of the day. A night's sleep could explain the morning bump-up. Biochemicals associated with a person's circadian rhythm could also be at work, and certainly what happens to you during a day would have an effect.

A New Dimension In Research

While the results might not be terribly surprising, they point to a new "social media" wave in academic research.

When it comes to research, "we've really been in flat Earth over all these years, and suddenly we've discovered there's a third dimension," says David Lazer, a practitioner of both political and computer science at Northeastern University.

Though tweets are public, Lazer says, academic institutions should be writing up ethics standards for the use of data from social media. He emphasizes that scientists should be careful about what they conclude from the data.

"I mean, these are not scientifically designed instruments to collect under pristine circumstances; it's often difficult to tell what's causing what," he says.

But Twitter certainly can reveal peoples' views. Kent Cavender-Bares is an environmental scientist at the University of Minnesota.

"I see it as a great way to get a pulse of what's going on in the country," he says. Cavender-Bares plans to monitor tweets about climate and then produce educational material to answer the most common questions.

He says you still need people to double-check computerized language scanners — after all, computers don't recognize sarcasm or some words with more than one meaning, like "blizzards."

"Real quickly you find out that people are tweeting about Dairy Queen Blizzards — an ice cream, rather than a snowstorm," he says.

The Cornell research appears in the journal Science.

Copyright 2018 NPR. To see more, visit http://www.npr.org/.

MELISSA BLOCK, Host:

From NPR News, this is ALL THINGS CONSIDERED. I'm Melissa Block.

MICHELE NORRIS, Host:

Surveys are only so good. It's hard getting a big enough sample to be sure of the results and that's particularly vexing for social scientists, who want a high standard of accuracy.

W: Twitter. NPR's Christopher Joyce reports on recent efforts by researchers to get tweets to do their work for them.

CHRISTOPHER JOYCE: Normally, if social scientists wanted to design an experiment on, say, how people's moods change during the course of a day, they'd recruit some of their students. But statistically, what 50 college kids do really doesn't reflect the American public. Scientists need lots of people to make solid conclusions about human behavior. That's why Scott Golder went to Twitter, where millions and millions of people express themselves daily.

SCOTT GOLDER: This is the stuff of social life, whether you're doing that with diaries from a few hundred years ago, or you're doing it with the tweets of today. You're still looking into the personal lives of regular people, and that is very revealing.

JOYCE: They used a common computer program that scans text for key words in tweets that reflect the writer's mood or, as psychologists call it, affect. Such as...

GOLDER: Aching, afraid, cynical, fear, mad, fury, poor, abandonment...

JOYCE: In a word, negative. As for the positive side...

GOLDER: Things like agree, definitely, fine, outgoing, paradise, pleasing.

JOYCE: And, of course, this being the Twitter generation...

GOLDER: Awesome. Awesome is an awesome word.

JOYCE: Golder is a graduate student in social and computer science. His team spent months scanning tweets by over 2 million people in 84 countries - half a billion tweets. Here's what they found.

GOLDER: We found that there are two peaks in positive affect during the day. One occurs first thing in the morning, and the other occurs late at night.

JOYCE: But, of course, you say, the dip in the middle is when you go to work. Golder says no.

GOLDER: The shape of the rhythm - or when it peaks and when it valleys - is the same on the weekend as during the week.

JOYCE: While the results might not be terribly surprising, they point to a new social media wave in academic research. David Lazer is a practitioner of both political and computer science at Northeastern University.

DAVID LAZER: We've really been in flat earth all these years and suddenly, we've discovered there's a third dimension.

JOYCE: Lazer notes that tweets are public, but he adds that academic institutions should be writing up ethics standards for the use of data from social media. And he says scientists should be careful about what they conclude from that data.

LAZER: I mean, these are not scientifically designed instruments to collect data under pristine circumstances. It's often difficult to tell what's causing what.

JOYCE: But Twitter certainly can reveal people's views. Kent Cavender-Bares is an environmental scientist at the University of Minnesota.

KENT CAVENDER: I see it as a great way to get a pulse of what's going on.

JOYCE: He says you still need people to double-check computerized language scanners. Computers don't recognize sarcasm or some words with more than one meaning, like blizzards.

CAVENDER: Real quickly, you find out that a lot of people are tweeting about Dairy Queen Blizzards - an ice cream rather than a snowstorm.

JOYCE: The Cornell research appears in the journal Science. Christopher Joyce, NPR News. Transcript provided by NPR, Copyright NPR.