Saturday, May 25, 2013
Saturday, May 25, 2013

Either listening to Paul McCartney makes you younger, or there's something amiss with social science.

Would you believe a scientific paper that said listening to the Beatles song "When I'm 64" made people get younger? It was tested by experiment, and the result came out with "statistical significance," which is the gold standard for incorporating new findings into the established scientific literature. The point of the experiment was not really to test the youth-restoring effects of the song, but to show how too many dubious studies are getting published in respected journals.

4 comments

Either listening to Paul McCartney makes you younger, or there’s something amiss with social science.

POSTED: Tuesday, June 5, 2012, 12:26 PM

Here’s a story on bad science that ran on the Inquirer's front page today (Tuesday). I got the idea from a fascinating paper in which researchers created a test case to show how dubious social science could pass acceptable standards of statistical significance. Others say the problem extends to medical research as well. Read the whole story here.

Would you believe a scientific paper that said listening to the Beatles song "When I'm 64" made people get younger?

It was tested by experiment, and the result came out with "statistical significance," which is the gold standard for incorporating new findings into the established scientific literature.

The point of the experiment was not really to test the youth-restoring effects of the song, but to show how too many dubious studies are getting published in respected journals. (If it were really true, Paul McCartney would get even richer.)

Wharton researcher Uri Simonsohn constructed the song experiment as a sort of test case, along with colleagues at the University of Pennsylvania and the University of California, Berkeley. They conducted a similar experiment showing that listening to the children's song "Hot Potato" made people feel older.

The researchers got both results using well-accepted practices for collecting, parsing, and analyzing statistical data, and both easily met qualifications for acceptance in peer-reviewed journals, said Simonsohn, a coauthor of the paper.

"It's unacceptably easy to publish statistically significant evidence consistent with any hypothesis," he said.

Read the rest here.

Faye Flam @ 12:26 PM  Permalink | 4 comments
4 comments
Comments  (4)
  • 0 like this / 0 don't   •   Posted 2:37 PM, 06/05/2012
    It's well-known that watching Elvis Presley swivel his hips spiked teenage pregnancies.
    jxxphilly
  • 0 like this / 0 don't   •   Posted 2:40 PM, 06/05/2012
    However, many people are unaware that the bird is the word.
    Another_1
  • 0 like this / 0 don't   •   Posted 8:49 AM, 06/06/2012
    Jonah Lehrer had an article in Atlantic Monthly a few years back where he showed many scientific results, though put in repeatable form, were not repeating. Statistical reasoning is all we have for much of what we conclude but it must be used judiciously and understood completely. For example, "statistical significance" has a very precise meaning that might surprise even seasoned researchers.
    nerdyseahorse
  • 0 like this / 0 don't   •   Posted 10:25 AM, 06/06/2012
    I've been leery of the Beatles math since they claimed there were "eight days a week."
    jxxphilly


About this blog
Faye Flam - writer
In pursuit of her stories, writer Faye Flam has weathered storms in Greenland, gotten frost nip at the South Pole, and floated weightless aboard NASA’s zero-g plane. She has a degree in geophysics from the California Institute of Technology and started her writing career with the Economist. She later took on the particle physics and cosmology beat at Science Magazine before coming to the Inquirer in 1995. Her previous science column, “Carnal Knowledge,” ran from 2005 to 2008. Her new column and blog, Planet of the Apes, explores the topic of evolution and runs here and in the Inquirer’s health section each Monday. Email Faye at fflam@phillynews.com. Reach Planet of the at fflam@phillynews.com.

Planet of the Apes
Blog Roll
 
 
 
 
Blogs on evolution
 
David Sloan Wilson
 
 
Other useful links
 
University of California Berkeley
 
Science blogs
 
Discover Magazine
 
Discover Magazine