GG was a bit disturbed in reading an Atlantic story describing how PLOS Biology and a few other journals were relaxing the rules on publishing papers that were scooped by rivals publishing the same results earlier (once again, pointed out by Retraction Watch). Responses from scientists as quoted in the article included “This changes EVERYTHING” and “This will change the career trajectory for many a disillusioned scientist.”
Really? What is going on?
It isn’t that allowing for parallel studies to make publication is bad, what bothered GG was the perception that this is righting an awful wrong that destroys many careers–that this is a BIG DEAL. From the way this is covered, you get the feeling that a lot of scientists are doing the exact same experiments with the exact same goals, but only the first to the finish line gets a publication. Now everybody gets a participation ribbon, right? If this truly reflects the state of biology these days, GG wonders if we have too many biologists. When considered in tandem with the “replication crisis” that also seems most focused in the biosciences along with the substantial number of retractions and fraud in that field, it feels like we are staring at an entire discipline in crisis, but not for the reasons they perceive.
It’s not like other fields don’t see work getting scooped, but it is far too rare to merit the kinds of plaudits this PLOS Biology practice garnered (In fact, lines of research in earth science are often distinct enough that truly being scooped so as to make a study unpublishable inspires questions of academic theft). So GG has to wonder if (1) certain lines of research are simply far overpopulated with researchers who (2) rush to get incremental results for publication, and in that rush (3) the least careful (or (4) most dishonest) are the most rewarded, which means that a significant fraction of new results are, in fact (5) non-reproducible. Now maybe GG misunderstands biology (well, OK, no “maybe”)–perhaps the bar on being novel is much higher in bioscience such that a paper reaching the same result from a different pathway becomes unpublishable. This is not the case in earth science: a paper determining, say, the slip history of an earthquake from seismological observations won’t preclude another paper getting the slip history from geodesy–or even other flavors of seismological data. Yes, you may have trouble getting your later geodesy paper in Science or Nature, but there won’t be barriers in discipline journals.
GG recently was reading the GSA Presidential Address of M. King Hubbert from 1963, and his complaint (he was an earlier grumpy geoscientist) feels relevant:
Within the university it is easily seen that such a system [of “publish or perish”] strongly favors the opportunist capable of grinding out scientific trivialities in large numbers, as opposed to the true scholar working on difficult and important problems whose solutions may require concentrated efforts extending over years or even decades. It took Kepler, working on the lifetime of astronomical observations of Tycho Brahe, 19 years to solve the puzzle of planetary motions, but the results were the now celebrated Keplerian Laws of Planetary Motion. Newton, with few intervening scientific publications, spent altogether some 20 years studying the mechanics of moving bodies before writing his great treatise Philosophiae Naturalis Principia Mathematica (1686) in which are derived the Newtonian Laws of Motion and the Law of Universal Gravitation. Twenty-two years of work, the last 11 essentially free of other writings, preceded Charles Darwin’s publication of On the Origin of Species by Means of Natural Selection (1859). How long could any of these men survive in an American university of today?*
If everyone is pursuing the same results with the same techniques over and over and over, it speaks to an absence of imagination, an unwillingness to explore, a pressure to indulge in groupthink–in essence, a desire to “grind out scientific trivialities in large numbers.” What all this noise and fury truly represents is not a terrible wrong committed against nobel scientists, but a gross corruption of the goals of science and a massively unhelpful and misaligned reward structure. Letting the late comers publish is hardly the big solution the Atlantic article claims; it is, in fact, helping to hide the main problem by rewarding the losers in a race that never should have been run.
*-An aside. Of course, if we gave all faculty 20 years to publish something, for every Darwin or Newton, we’d have hundreds of deadwood research faculty. Hubbert was in fact arguing that research as supported by the government should be moved out of the university.
Perhaps the most bizarre aspect of the migration to electronic media is continued use of one of the most annoying aspects of the original print-electronic split, namely the electronic supplement. Originally intended as a way to keep things like data tables from overwhelming print copies of journals, this appendage to publications has become more a scourge than a help.
The first attempt in the geosciences to do something like this was the ill-fated split of GSA Bulletin papers into a paper version and a microfiche version (ick). This actually devastated the journal as authors fled to safer harbors. As more and more papers are being accepted with small stubs as the “article” and the main text as the “supplement”, journals seem hellbent on replaying GSA’s old blunder. The only difference is that this time, there is no real excuse for doing so.
Basically, at this point, why would any supplement that is either text or pdf format be excluded from being part of the electronic version of a paper? These are often no larger files than the “main” article, and increasingly these parts of papers are where the real nuts and bolts are that you need to really evaluate a paper.
There might be reason to keep supplements for non-readable materials (binary files, mainly), but it is time to bury them for stuff that is human-readable. Call these things appendices, put them at the end of the paper, and include them directly when you go to download the article. Enough of this business of realizing later, after you’ve pulled down the article and started to go through it thoroughly, that the guts are still sitting somewhere online. Worse, all too often the outline of the logic is in the main paper while the supplement contains the pieces of the body, often tossed together in a disorganized heap that was spared any copy editing. Reassembling the true logic of the scientific work is harder than it would have been had the paper been written as (gasp!) a single, long paper.
Why are we continuing to allow paper journal formats to mangle our science?
Well, its been several months since The Mountains that Remade America came out, and it feels like it is worth a moment to contemplate the process, particularly the surprises. Just in case anybody else is interested.
Writing an academic trade book is kind of neither fish nor fowl. A textbook is in some ways a glorified collection of lecture notes. Now you do have to go through and fix up things, and often you realize there are things you don’t teach that should be in the book, but this is material you are deeply familiar with. Often the hardest part is coming up with exercises at the end of chapters that aren’t too bland and aren’t too hard. Tedious, yes. In some ways the oddest part about textbooks is that you don’t generally cite the source material the way you might in a journal article, which can be liberating.
A regular trade book (you know, like novels or anything without footnotes) is similarly liberating: maybe you sort of recall some piece of information, and you are pretty confident it is right, but you can’t lay your hands back on it, well, you can stick it in. Now depending on the topic, a fact checker might be employed to look for mistakes, but that can be somebody else’s job.
No, an academic trade book rests on the author’s shoulders more squarely. Read More…
“Publish or perish.” So goes the mantra supposedly defining academic life. The implication is that publication is enough. We can all agree that unpublished science is not going to have much of a chance of influencing the course of scientific thought, but is the act of publication really enough?
There are a number of instances of science rediscovering things. Perhaps one of the more familiar stories is that of Gregor Mendel, whose work, goes the story, went unread by Darwin and unnoticed by others, leaving Mendel to die in obscurity, his work only appreciated years later when it was rediscovered. While this story is largely wrong, it does resemble some lesser known cases. That blog post listing some of the rediscoveries concludes by saying, in essence, this won’t happen in the future. Our literature discovery tools are too good.
Nonsense. (At least for now). Read More…
GG has been rather abrupt in some previous posts with some authors over choices made in making maps for publication, and some of the authors have been insulted, in part because GG seems to have mistaken a conscious choice for laziness or thoughtlessness. Its not like GG is free and clear on making mistakes, so today let’s review a few boo-boos of GG.
First up is one we discussed before, the use of gradient color:
GG was the thesis advisor and second author here, and there are two main problems. One is the rainbow color map, which is widely panned for the challenges it places before those with some level of color blindness. [Alternate color schemes are nicely described here and you can test how images look to the color-blind here. The only good news for this figure is that a continuum of color is more decipherable than separated color blobs]. The other problem is that the colors are continuous. Can you tell -2.2 from -2.6? This probably would have been better with discrete color steps. But that’s probably not the complete answer:
This is from Jones et al., 1994, showing travel time residuals with a discrete color bar. On the left is the original, on the right as viewed by a red-blind viewer (as created by Coblis). While the Levandowski et al. image could be deciphered because of smoothly continuous colors, this figure becomes hopeless. (Plate 2 in Jones et al., 1994, is even worse, but GG can’t recover the original file to show this cleanly, and plate 3 is an utter disaster for red-green colorblind). There are similar examples in later tomography papers. Frankly, using some of the better diverging color maps out there would be a better practice.
Recently, Paul Braterman pointed out the pro-truth pledge. It is an interesting idea and noble, in its own way, and certainly worth a look given the current environment, which would make Joseph Goebbles blush. But there is something about it that bothers GG, and it is in some ways tangled with the roots of science.
It is one thing to lie. That is deliberately communicating a falsehood, something known to not be true. And we have seen a tremendous increase in bald-faced lying in the past couple of years. So fighting lying–and committing to trying hard not to propagate falsehoods–is a perfectly fine endeavor. Being reminded, as the pro-truth pledge does, of the many ways we can inadvertently transmit untruth is valuable.
But telling truth…that is actually hard for many things. Sure, simple things are easy–did you eat the last cookie? Was the bill paid on time? But for science, it is hard to be sure you are telling the truth. You can recognize lies or other related deceptions, but truth? Most scientists would agree that you can’t prove a hypothesis, only disprove it. Rather like some kind of convergent infinite series, the more a hypothesis survives disproof, the closer it likely is to truth. But some wrong theories were awfully close for a long time: Newtonian mechanics is, technically, wrong given relativity. In a sense, when we ask intro physics students to determine the velocity of a body after a collision, we demand that they lie because they aren’t telling the whole truth. In a practical sense, it would be ridiculous to include relativity when talking about a couple of bowling balls colliding at a couple kph. But does truth accommodate approximation? How far can you stray before you are lying?
Plate tectonics is, in a real sense, a lie for large parts of the earth’s surface. Strictly defined, plate tectonics means the surface of the earth is divided into rigid pieces of shell where infinitesimal edges accommodate all motion. This does not describe most of east Asia or the western U.S., for starters. Yet plate tectonics is closer to truth than geosynclinal theory or a contracting earth.
Consider a more treacherous playing field: evolution. We can state very clearly the relationships in the fossil record and claim a name for the progressions observed as evolution, and it is awfully hard to defame that as a lie. As a description of observation, it might be as close to truth as we can get in geoscience. But any explanation for those patterns is a theory, and any particular theory is likely to run into problems in some detail somewhere. Is natural selection truth? Its awfully good, but truth? A high bar to clear.
Truth implies an absolute. Science doesn’t have those; the best we can do is rank things in some order of increasing truthfulness. So if you get holier-than-thou on somebody about, say, how earthquakes in Oklahoma are all obviously artificial and not natural, be ready to have somebody point out the Meers Fault and historic intraplate earthquakes to let you know that while much of the seismicity in Oklahoma is triggered, some might not be. Perhaps you want to say “it is more accurate to say…” than “the truth is…”.
In looking at the little advertisements (“press releases”) for newsworthy new science that is the website SciTechDaily, GG found this stunning assertion:
First-of-Its Kind Seismic Study Challenges Concepts of Geology
Wow! A first-of-its-kind study and challenging some unnamed concepts of geology. Not every day that happens. What was more, the study was authored by well-respected scientists like Vadim Levin, who was quoted in the puff piece saying “The upwelling we detected is like a hot air balloon, and we infer that something is rising up through the deeper part of our planet under New England.”
Frankly, this is a case of university promotion run amok, and Vadim has to take at least partial ownership.
First, the study is hardly the first of its kind. It compares tomographic wave speeds with measurements of shear-wave splitting, stuff that has been done now for decades. What is new are some SKS splitting measurements from some sites that hadn’t been included in previous regional studies. The splitting magnitudes were small, suggesting that the regionally present transverse [horizontal] anisotropy was damped or reoriented in this region. Yet we get quotes from Vadim (who certainly should know better) like this: “Our study challenges the established notion of how the continents on which we live behave.”
Oh, be real. This study is not about to rewrite the textbooks despite Levin’s statement that “It challenges the textbook concepts taught in introductory geology classes.”
Look, the paper is perfectly fine. But it was not the work that originated the idea that this body under New England was a convective upwelling; in fact, those papers don’t challenge any notion about continents, instead suggesting that the trailing edges of continents might generate convective motions in the mantle. (Vadim was a coauthor on at least one of these papers published a year ago).
Clearly the hype with the press release is way out of proportion to the significance of the paper. This is not how we should be promoting science; in fact, it is just the kind of press release that can torque other workers in the field. GG’s view is that scientists need to control their message–not only in their papers but in the press releases they contribute to.
As an aside, how believable is this interpretation? Read More…