• Home
  • About
  • Contact
  • Good places to start

Memoirs of a SLACer

sociological views on life and the liberal arts

Feeds:
Posts
Comments
« If I had a time machine
Privileging the loud »

The broken review system

November 17, 2015 by John

A while back, Philip Cohen posted on some of the problems with the peer review system in sociology, sharing the story of a paper that underwent 13 peer reviews over several years in the publication gauntlet. Although the paper’s findings were essentially unchanged by this process, each reviewer apparently thought that the paper could be framed in a different, and better, way. As Cohen says:

Most (or all) of the reviewers were sociologists, and most of what they suggested, complained about, or objected was about the way the paper was “framed,” that is, how we establish the importance of the question and interpret the results. Of course framing is important – it’s why you’re asking your question, and why readers should care (see Mark Granovetter’s note on the rejected version of “the Strength of Weak Ties”). But it takes on elevated importance when we’re scrapping over limited slots in academic journals, so that to get published you have to successfully “frame” your paper as more important than some other poor slob’s.

Cohen also cites problems with the journal system and its speed and arbitrary nature, but I think that the issue of framing is particularly important because journal editors appear to be letting reviewers asking a version of the “why didn’t you write the paper I would have written?” conference question arbitrarily prevent the publication of otherwise-worthy papers. This is particularly problematic for graduate students and those of us who work at teaching-oriented institutions and don’t typically have numerous papers under review at once.

Cohen proposes an alternate peer review system, but barring major changes in the system, I think that editors can take immediate steps to address this issue. When somebody asks the “why didn’t you write the paper I would have written?” question at a conference, everybody else in the audience rolls their eyes and recognizes the problem. Journal editors need to be more forceful about recognizing these problems themselves, providing clearer review guidelines and ensuring that framing is not the single most important factor in their decisions.

Via: Scatterplot

—

“Like” Memoirs of a SLACer on Facebook to receive updates and links via your news feed and use the comments to complain about their framing.

Share this:

  • Facebook
  • Twitter
  • Tumblr
  • More
  • Email
  • Pinterest
  • Reddit

Like this:

Like Loading...

Related

Posted in The Ivory Tower, The Publication Gauntlet, The State of Sociology | Tagged Memoirs of a SLACer, Peer Review, Philip Cohen, Publish or Perish, Scatterplot, The Publication Gauntlet |

  • Pages

    • About
    • Contact
    • Good places to start
  • Previous Posts

    November 2015
    M T W T F S S
     1
    2345678
    9101112131415
    16171819202122
    23242526272829
    30  
    « Oct   Dec »
  • Categories

  • Blogs I Read

    • Conditionally Accepted
    • Crooked Timber
    • Female Science Professor
    • Historiann
    • orgtheory.net
    • scatterplot
    • Small Pond Science
    • Soc'ing Out Loud
    • Sociology in Focus
    • Sociology Source
    • Sociology Toolbox
    • Tenured Radical
    • The Society Pages
    • whatisthewhat
  • Enter your email address to subscribe to this blog and receive notifications of new posts by email.

  • Meta

    • Register
    • Log in
    • Entries feed
    • Comments feed
    • WordPress.com
  • Site Meter

    Site Meter

Blog at WordPress.com.

WPThemes.


Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
To find out more, including how to control cookies, see here: Cookie Policy
  • Follow Following
    • Memoirs of a SLACer
    • Join 117 other followers
    • Already have a WordPress.com account? Log in now.
    • Memoirs of a SLACer
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Copy shortlink
    • Report this content
    • View post in Reader
    • Manage subscriptions
    • Collapse this bar
%d bloggers like this: