Journal prestige and publishing from a teaching institution

Finally. There are journals publishing quality peer-reviewed research, but leave it to the reader to decide whether a paper is sexy or important. Shouldn’t this be better than letting a few editors and reviewers reject work based on whether they personally think that a paper is important or significant?

This newish type of journal uses editors and reviewers to assure quality and accuracy. The biggie is PLoS ONE. A newer one on the block is PeerJ. Another one asked me to shill for them on this site.

The last few years have seen a relatively quick shift in scientific publishing models, and there has been a great upheaval in journals in which some new ones have become relatively prestigious (e.g., Ecology Letters) and some well-established journals have experienced a decline in relative rank (e.g., American Journal of Botany). These hierarchies have a great effect on researchers publishing from small ponds.

Publishing in selective journals is required to establish legitimacy. This is true for everybody. Because researchers in small teaching institutions are inherently legitimacy-challenged, then this is the population that most heavily relies on this mechanism of legitimacy.

Researchers in teaching institutions don’t have a mountain of time for research. Just think about all of the time that could be spent on genuine research, instead of time wasted in the mill of salesmanship that is required to publish in selective journals. (I also find that pitching research as a theory-of-the-moment to be one of the most annoying parts of the business.)

With new journals that verify quality but not the sexiness, we can hop off the salesmanship game and just get stuff published. Sounds great, right?

After all, the research that takes place at teaching institutions can be of high quality and significant within our fields. But, on average, we just don’t publish as much. That makes sense because our employers expect us to focus on teaching above all else.

Since we’re less productive, then every paper counts. We want to get our research out there, but we also need to make sure that every paper represents us well. What we lack for in quantity, we need to make up for in (perceived) quality.

How do people assess research quality? The standard measure is the selectivity of the journal that publishes the paper. It’s natural to think that a paper in American Naturalist (impact factor 4.7) is going to be higher quality than American Midland Naturalist (impact factor 0.6).

People make these judgments all the time. It might not be fair, but it’s normal.

And no matter how dumb people say it might be, no matter how many examples are brought up, assessments of ‘journal quality’ aren’t going away. No matter how much altmetrics picks up as another highly flawed measure of research quality, the name of the journal that publishes a paper really matters. That isn’t changing anytime soon.

The effect of paper on the research community is tied to the prestige of the venue, as well as the prestige of the authors. Fame matters. If any researcher – including those of us at teaching institutions – wants to build an influential research program, we’ve got to build up a personal reputation for high quality research.

Building a reputation for high quality research is not easy at all, but it’s even harder while based at a teaching institution. Just like having a paper in a prestigious journal is supposed to be an indicator of quality research, a faculty position at a well-known research institution is supposed to be an indicator of a quality researcher. Since our institutional affiliations aren’t contributing to our research prestige, we need to make the most of the circumstances to establish the credibility and status of the work that comes out of our labs.

If journal hierarchies didn’t exist, it would be really hard for researchers in lesser-known institutions, who may not publish frequently, to readily convince others that their work is of high quality. Good work doesn’t get cited just because it’s good. It needs to be read first. And work in non-prestigious journals may simply go unread if the author isn’t already well known.

If journal hierarchies somehow faded, it’s not as if the perception of research quality would evolve into some perfect meritocracy. There are lots of conscious and unconscious biases, aside from quality, that affect whether or not work gets into a fancy-pants journal, but it is true that people without a fancy-pants background still can publish in elite venues based on the quality of their work. This means that people without an elite background can gain a high profile based on merit, though they do need to persevere though the biases working against them.

If journals themselves merely published work but without any prestige associated with them, then it would be even more difficult for people without well-connected networks to have their work read and cited. It wouldn’t democratize access to science; it would inherently favor the scientists with great connections. At least now, the decisions of a small number of editors and reviewers can put science from an obscure venue into a position where a large audience will see it. On the other hand, publishing in a journal without any prestige, like PLoS ONE, will allow work to be available to a global audience, but actually read by very few.

If I want my work to be read by ecologists, then publishing it in a perfectly good journal like Oikos will garner me more readers than if I publish it in PLoS ONE. Moreover, people will look at the Oikos paper and realize that at some point in its life, there was a set of reviewers and an editor who agreed that the paper was not only of high quality but also interesting or sexy enough to be accepted. It wasn’t just done well, but it’s also useful or important to the field. That can’t necessarily be said of all PLoS ONE papers.

Not that long ago, I thought that these journals lacking the exclusivity factor were a great thing because it allowed everybody equal access to research. What changed my mind? The paper that I chose to place in PLoS ONE.  I chose to put a paper that I was really excited about in this journal. It was a really neat discovery, and should lead to a whole new line of inquiry. (Also, the editorial experience was great, the reviewers were very exacting but even-handed, and the handling editor was top notch.)

Since that paper has come out just over a year ago, there have been a number of new papers on this or a closely related topic. But my paper has not been cited yet, even though it really should have been cited. Meanwhile they’re citing my older, far less interesting and useful, paper on the same topic from 2002.

Why has nobody cited the more recent paper? Either people think that it’s not relevant, not high enough quality, or they never found it. (Heck, the blog post about it has been seen more times than the paper itself.) Maybe people found it and then didn’t read it because of the journal. It’s really a goddamn great paper. And it’s getting ignored because I put in PLoS ONE. I have very little doubt that if I chose to put it in a specialized venue like Insectes Sociaux or Myrmecological News, both good journals that are read by social insect biologists, that it would be read more heavily and have been cited at least a few times. This paper could have been in an even higher profile journal, because it’s so frickin’ awesome, but I chose to put it in PLoS ONE. Oh well, I’ve learned my lesson. There are some papers in that venue that get very highly cited, but I think most things in there just get lost.

I would love for people to judge a paper based on the quality of its content rather than the name of the journal. But most people don’t do this. And I’m not going to choose to publish in a venue that may lead people to think that the work isn’t interesting or groundbreaking even before they have chosen to (not) read it. I’ll admit to not placing myself on the front of reform in scientific publishing, even if I make all of my papers immediately and universally available. I have to admit that I’m apt to select a moderately selective venue when possible, because I am concerned that people see my research as not only legitimate but also worthwhile. I’m not worried that my stuff isn’t quite good, but I want to make sure it’s not done in vain. Science is a social enterprise, and as a working scientist I need to put my work into the conversation.