/ #Add new tag #impact factor 

Publish and... perish

In the old days, research quality was measured by the number of papers you published. Publishing was a hard process and only few scientists were able to publish several papers per year. However, with the bloom of new journals, the appearance of electronic editorial process, and the specialization of research fields, the number of publications per year has grow exponentially during the last decades. Thus publishing is not longer a good measure of the quality of research. As an example if this I recently attended a talk by Sid Redner in which he showed the following data extracted from the Physical Review citation data of 353000 papers:

  * Only 11 papers got more than 1000 citations
  * 245000 got less than 10 citations
  * 100000 got one or none citations

For me it is amazing to see that roughly 1/3 of the papers published got almost no citations at all. It is a publish and perish process in which 1/3 of the papers are lost.

long-tail The situation is similar to what has been found recently in the music industry.  Out of 13 million sons available to buy online, 10 million of them have never been bought. As Will Page put it:

  * Only 20% of the tracks in their sample are 'active', that is to say they sold at least one copy, and hence, 80% of the tracks sold nothing
  * 80% of the revenue came from around 3% of the active tracks
  * Only 4 tracks sold more than 100000 copies

This led Will Page to question the Long-Tail theory by Chris Anderson which states that the market share of low demanded items can be bigger than that of best-sellers. To put it in mathematical terms, the mass of the distribution in the tail of can be bigger than the mass around the peak of the distribution. This happens mostly with Pareto-law distributions and thus the name “long-tail”. But Will Page’s data seems to suggest that there is not even such a tail and planning your business in the long tail is risky: if you center your business plan in trying to sell the tail of the distribution, most probably you won’t succeed. As Andrew Bud (Executive Chairman from Mblox) put it: “in this tail, you starve”

The same can happen to a journal if it lives in the long-tail: what is the fraction of perishable papers a editor of a journal is willing to accept? What is the “citation model” the journal is intending to have? We all know about the impact factor of a journal, which is only giving us information about (mostly) regular-cited papers. A better information will be also the zero-index of a journal (or a researcher), i.e. the fraction of papers that never get cited at all. An idea I am working on recently… Stay tuned



Professor at Universidad Carlos III de Madrid and MIT Medialab. Working on Complex Systems, Social Networks and Urban Science.