29 Jun 2007

Science hype it up

"First genome transplant turns one species into another".

Wow! Really? That sounds amazing!!

"Scientists have converted an organism into an entirely different species by performing the world's first genome transplant, a breakthrough that paves the way for the creation of synthetic forms of life".

No kidding! "An entirely different species"?! What was it, turning a whale into a petunia!?!

And it's a paper in Science!?

This must be big!!!!!

Wait for it....

Here it is..........

"In the experiment, researchers extracted the whole genetic code from a simple bacterium, Mycoplasma mycoides. They squirted the DNA into a test tube containing a related species, Mycoplasma capricolum. They found that some of the bacteria absorbed the new genome and ditched their own. These microbes grew and behaved exactly like the donor".

Oh.

Can I piss on their fire now?

These mycoplasma are very closely related:
"The members of the M. mycoides cluster are very closely related, as judged from biochemical, physiological, serological, and 16S rRNA sequence data, but cause different diseases in various animals. M. capricolum subsp. capripneumoniae has a property unique among members of the M. mycoides cluster in that it has an unusually large number of polymorphisms in the two 16S rRNA genes. There are, in fact, more sequence differences between the rrnA and rrnB operons of M. capricolum subsp. capripneumoniae than between the 16S rRNA genes of homologous operons of different species within the M. mycoides cluster. This characteristic can possibly be explained by more rapid evolution due to a relatively recent change to a host to which this mycoplasma has not completely adapted".
Note: "relatively recent change". And M. capricolum is more diverse than M. mycoides, so you might expect these cells to be able to take up M. mycoides genomes. They're practically the same species. Bacteria are quite fuzzy about species anyway.

It is an interesting experiment, but this has been hyped up beyond a joke.

28 Jun 2007

Open peer review & community peer review

There has been a lot of discussion about 'open peer review' lately - this letter to Nature is just the latest example. With all these opinions and hypotheses about peer review flying around, I think that it is useful to make some distinctions between the different types of 'open' review, so here goes.

Traditional peer review. Anonymous reports received pre-publication. Letters to the editor are considered by many journals, but especially in paper journals relatively few are published. All the BioMed Central journals accept signed comments from readers.

Open peer review. Named, pre-publication review, which is how the BMC-series medical journals work, and the BMJ too. The difference lies in that the reviews are available for readers to see in the BMC-series medical journals, but the BMJ never made this move. Comments can also be posted by readers: the BMJ's Rapid Responses should be envied by any journal. It is controversial as some reviewers don't wish to be named, and it can make finding peer reviewers harder, but to anyone who doubts the open peer review works I can point out that the BMJ has published hundreds of peer reviewed articles since it introduced open peer review, and the medical journals in the BMC series have published thousands of peer reviewed articles since they launched in 2000. Open peer review can work.

Open and permissive peer review. This is Biology Direct's approach. Articles are published if they receive reviews solicited by the author from at least 3 members of the reviewing board (aside from pseudoscience, which the editors will veto), with the comments included at the end of the article, unless the author withdraw the manuscript. More here, and I discussed their approach in a previous post. Comments can be posted by readers, as with the other BioMed Central journals.

Community peer review. The idea of community peer review is to avoid peer review being the domain of a biased subset of the scientific community, and it has a powerful philosophy that "given enough eyeballs, all bugs are shallow". It can be either anonymous or named, and still happens before formal publication, but the difference is that reviewers volunteer rather than being selected by the editors. The manuscript is public while under review, but explicitly is not 'published' at that point. This was how Nature's experiment worked (or didn't work), but it was alongside the usual anonymous editorially selected reviews, and the comments don't seem to have been treated as 'proper' reviews by the editors.

Atmospheric Chemistry and Physics uses a similar approach, apparently with much more success than Nature. The editors refuse articles that don't meet minimal scientific standards, then post the remaining articles for 8 weeks of Interactive Public Discussion (named or anonymous), then publish the final version. There doesn't appear to be any mention of rejecting articles after the initial public posting, so this permissive peer review resembles a community version of Biology Direct.

The Journal of Interactive Media in Education uses named reports, and invites review from the community. The two-step process involves private, named review by invited reviewers, followed by publication of a preliminary version that is reviewed further by the community before final, formal publication.

Permissive peer review, post-publication commentary.
This is PLoS ONE's approach. They have minimal peer review, with the expectation that the scientific community will then comment on and annotate the articles. I was already a bit skeptical of the merits of minimal peer review, as are others, and now a Nature news story, among others, has attacked the publication of a study on HIV and circumcision in PLoS ONE, arguing that peer review failed in this case. Sending out an unbalanced press release written by the author seems to have compounded the problem, and wasn't very responsible. A lengthy response has been posted to the article, showing that post-publication review can work, but plenty of journals have the option to post comments, and the horse has already bolted.

No peer review, post-publication commentary.
This is how Philica works, and now Nature Preceedings, part pre-print, part repository for preliminary work. I don't think that Philica is working; Nature Preceedings will probably fare better. An essential difference is that while Philica is clogged with pseudoscience, Nature Preceedings explictly won't post pseudoscience, and it has the Nature brand name to help it gather interest and comments. I found an optimistically titled Web 2.0 Peer Reviewed Science Journal, which has a website but no articles. "This page that you are reading now is a review site, and I (Philip Dorrell) am the intended reviewer. If you, as an author of a scientific paper, are interested in having me review your paper, all you have to do is publish your paper as a web page, and then send an email". Hmm... sorry Philip, but peer review involves more than just your opinion on articles. Web 2.0 requires users and content.

BioMed Central is open access, PLoS is open access, the BMJ is open access, Nature Preceedings is open access, and they are all experimenting with peer review. Matthew Falagas has commented in Open Medicine (the open access journal that arose out of the editorial dispute at the CMAJ), after spotting this pattern of a link between experimenting with peer review and open access. I think it is worth stating that despite this trend, open access and open peer review don't necessarily go together. The biology journals in the BMC-series still have anonymous review, as do the PLoS journals. The problem of access to an article is at a tangent to the problem of reviewing it - but, of course, community peer review can't work if not enough people have access to the article.

I think that if there is doubt in the integrity of peer review (and there is more and more doubt), this increases the imperative for exposing pre-publication review processes. Journals can't just be paternalistic or secretive about peer review, and readers shouldn't take it on trust that an article labelled as 'peer reviewed' has been rigorously critiqued by experts in the field. PLoS ONE is encouraging its reviewers to make their reviews public on the published article, which is a great step. Requiring reviewers to opt-out would be even stronger, but PLoS Medicine recently backed away from this policy.

If journals really want community peer review to work, we cannot just sit back and wait for comments to come in. Pre-publication peer review takes a massive effort on the part of editors to find qualified reviewers, and the chances of enough qualified reviewers stumbling across an article and feeling obliged to leave comments to make post-publication review viable and vibrant are low. Ways to solicit comments are essential, using email alerts for example. In a definite step in the right direction, PLoS ONE is organising virtual 'journal clubs'. Remember that anyone who has had a face-to-face journal club at their institute about a BioMed Central article, or a BMJ article, or a PLoS article, can and should post the results of the discussion as a comment on the article.

I think that open peer review and community peer review are the future of assessing scientific articles. It doesn't stop there - I've not even mentioned wikis!

18 Jun 2007

omg web 2.0 is kewl

I'm not going to try any sort of systematic assessment of 'Web 2.0' and science, or even bother with a definition. This is just a stream-of-consciousness post, prompted by my wide-eyed wonder at the explosion of social networking and 'user generated content'.


Nature have completely bought into all this Web 2.0 malarkey - they've got umpteen blogs, Nature Network, Connotea, a new aggregator thingy called Scintilla, Postgenomic... they've even got a group on the "social notworking" site Facebook and an island in Second Life.

Social networking is a huge part of Web 2.0. Myspace is a mess, Facebook is more for play than for work, but The Scientist recently profiled the use of the 'Facebook for professionals' site, LinkedIn, by scientists. Another site that I've yet to look at properly is SciLink.

Social bookmarking is quite the thing. As well as Connotea, there's citeulike, another shared record of articles people came across and liked (hence the name). All the BioMed Central journals have feeds on citeulike, and we're collaborating with them.

A hybrid of social networking and social bookmarking is Stumbleupon. This is a brilliant way to find random websites that might of interest
- each user can give a thumbs up or thumbs down to every website they visit, and write a review of it.


You specify the topics you're interested in (music, film, science), and then hit the 'Stumble' button, and a page in that area appears. It is tuned by the sites you've said you like or dislike. As well as 'stumbling', you can also view the sites a user has rated and reviewed, which acts as a kind of blog of their browsing. This is a glorious way to waste time, but the same functionality applied specifically to scientific literature would give a great way to serendipitously browse the literature.

Another great 'overlay' to the web is WOT, or the Web of Trust. Very simply, you rate how trustworthy a site appears, generally speaking or specifically as a business partner, in keeping personal information, and as a safe site for children. A little icon appears by hyperlinks, green for OK or red if warning you that you are about to visit a site others have deemed untrustworthy or unsafe. Genius.

JournalReview gets around the barrier of some publishers not taking comments and having restrictions on letters by letting anyone comment on any article in PubMed. It's got a bit of a medicine bias, could still be more user friendly, and could really develop into a mature post-publication review process if it insisted on named reviews (or at least pseudanonymous reviews), and used trust metrics. And could someone use Greasemonkey to reveal comments from Journalreview when viewing PubMed abstracts, or even publisher sites? David Rothman has profiled a plethora of similar sites, in a great series of posts titled 'Digg for the medical literature'. Another good aggregator of information about scientific articles is the brilliantly simple PublicationsList - researchers can use it to, well, list their publications. They're going to need a name disambiguator pretty soon though. ScientificCommons is doing much the same, and I like their layout more.

One of the most notable Web 2.0 pages is Youtube, the video sharing site. In a wonderful example of circularity, an anthropology professor, Michael Wesch, has posted a 5 minute video guide to Web 2.0, The Machine is Us/ing Us -
I've had it embedded at the bottom of my blog for a while now. You can also find out why the banana is the atheist's nightmare. Youtube doesn't seem to be of much practical use to scientists, but there is a 'Youtube for science', the Journal of Visual Experiments, or JoVE.

Anyone can now get involved in scientific research without being a guinea pig in a drug trial. Distributed computing first came into the public consciousness with SETI@Home, and now similar applications are popping up in biology. I've got Folding@Home running on my laptop; it's helping to calculate the folding of supervillin at the moment.


No mention of Web 2.0 would be complete without referring to Wikis. Wikipedia is the best known and biggest - the encyclopedia that anyone can edit. The accuracy of Wikipedia, or rather the lack of accuracy, has received quite a lot of flak, in particular the entries about science. I'm almost left speechless by these criticisms. If you spot an error in Wikipedia, and it exercises you so much that you complain about it in public - just edit it! You don't even need to register! Sheesh. Another criticism is that it can be written by experts to be impenetrable to the outsider. As someone noted on that blog post, "don’t bitch when your encyclopedia gives you too much information. That’s its freakin job". Knowing something about serpins, I checked out the entry, and it's frankly excellent. The entry for antitrypsin is not so great, so I gave it a quick edit and flagged it as needing more references.

Of course, blogs are now reviewing articles post-publication. There is a Greasemonkey script from Pedro Beltrao that adds trackbacks to posts from Postgenomic to articles on Nature. I just tweaked it very simply to also be active on www.biomedcentral.com/* , and it works on our sites too. Cool. And now I see that Noel O'Blog has extended it to automatically work on PLoS, PNAS and BioMed Central. Thanks Pedro and Noel! Once you have it installed (which takes seconds if you have Greasemonkey), you can see it in action. Doesn't it look pretty?

By the way, the ungrammatical title of this post owes a debt to Ratcatcher's blog (which itself owes a debt to this Wondermark cartoon) and is reminiscent of a recent (and entirely useless) example of user generated content: lolcats. In case this craze has passed you by, it involves pictures of cats, with deliberately poorly written and humorous captions in bold text. Otherwise sensible linguists on Language Log have been led astray by this 'meme', and there's even a programming language based on the unique grammatical style of lolcats, lolcode. The web doesn't have much to top this.

14 Jun 2007

Well done, Reed Elsevier

As has been reported in many places, Reed Elsevier will stop their involvement in defence exhibitions this year. It's an impressive example of how protest can give results. Congratulations to Reed Elsevier for listening to the calls for them to do this.

The perils of editing

The editor of Fertility and Sterility has apologized to authors he accused of plagiarism and lying in The Scientist. Without getting into the rights and wrongs of this particular case, the legal threats flying back and forth serve to highlight why you need to tred carefully when accusing authors of misconduct!

Brian Deer in the BMJ recently reported on the controversy surrounding Mark Geier, a brave move for the journal's editors considering Dr Geier's familiarity with litigation, and also considering that they had recently apologised and paid £100,000 to Matthias Rath, another controversial doctor who they had accused of fraud.

It is fortunately not too often that journals receive threats of legal action, but I remember one author saying that he would sue us for rejecting his article; I remember, as I had handled that manuscript. Peter Newmark, our Editor-in-Chief at the time, gave this pretty short shrift, and sent the authors a response that put quite plainly his dim view of them threatening one of his editors like that. They didn't sue.

Journalology roundup #8

Sean Eddy Celebrates Open Access in Franklin Speech. "Sean Eddy [editorial board member of BMC Bioinformatics] accepted the 2007 Benjamin Franklin Award and then proceeded to poke a few good-natured holes in Franklin’s sterling open access reputation".
I blogged about this in my first post on the official BioMed Central blog.

Peer review in open access scientific journals
. "Open access publications should be at the forefront in experimenting with strategies to foster what might be called an increasingly open science. As the open access movement blossoms, its supporters should continue to critically evaluate the parallel development of openness and transparency in the peer review process. We need to ensure that a commitment to high-quality peer review is maintained... Open access journals are in an ideal position to test the merits of open, unblinded, peer review". Although BioMed Central is open access and our medical journals have open peer review, there's no necessary connection between the two. However, I was surprised to see no mention of us at all in Matthew Falagas' article, considering that we have been consistently running full open peer review on more journals and for longer than any other publisher I know of.

Open journals' records to give reviewers their due. "I ... propose that journals' records should be made publicly available after an adequate lapse of time, including the names of reviewers and the confidential comments exchanged between editors and reviewers".

Diverse journal requirements for data sharing. "Conclusions: kudos to Nature and Science. I’m surprised that the policies of other journals are so lax". Point taken - BMC Bioinformatics was included in this comparison, and although we didn't fare too badly, we'll take another look at our policies

Hwang case review committee misses the mark. "The Hwang committee's report indicates that it is becoming unacceptable for journal editors to hide behind the veil of peer review".

Factors Associated with Findings of Published Trials of Drug-Drug Comparisons: Why Some Statins Appear More Efficacious than Others. "This study examined associations between research funding source, study design characteristics aimed at reducing bias, and other factors that potentially influence results and conclusions in randomized controlled trials (RCTs) of statin-drug comparisons....RCTs of head-to-head comparisons of statins with other drugs are more likely to report results and conclusions favoring the sponsor's product compared to the comparator drug".

Modellers seek reason for low retraction rates. How scientific literature is shaped by withdrawn manuscripts.

Clinical trial registration: looking back and moving ahead. "Three years ago, trials registration was the exception; now it is the rule. Registration facilitates the dissemination of information among clinicians, researchers, and patients, and it helps to assure trial participants that the information that accrues as a result of their altruism will become part of the public record". Take your pick where to read it!

Stem cell figure retracted by Nature
. Stem cell research seems dogged by errors and misconduct!

Science, being Green, and the precautionary principle

I'm feeling the conflict between being involved in science and being in the Green Party. A lot of members of the Green Party are instinctively opposed to many modern technologies and scientific practices, such as animal research, GM and lately, mobile phone and WiFi radiation. This attitude often rests on the precautionary principle, the idea that if something might cause harm it is better to act as though it does cause harm rather than to hope that it won't. I'm not opposed to this principle, but I despair at the tendency of the green movement (and newspaper weekend supplements) to succumb to hype and scaremongering. A prime example is Julia Stephenson, who is the Kensington and Chelsea Green candidate, and is a columnist for the Independent. She wrote a column recently, titled "My war on electrosmog", describing her efforts to rid her life of electromagnetic radiation after having her feelings of fatigue 'diagnosed' by her naturopath (not her GP, mind) as due to 'electrosmog'. Sigh. Particularly infuriating is the advertisement at the end of the article of "Magnetic field protection boxes" (start at £235!), "Q-Link Pendants", "Anti-radiation mobile phone headsets" etc. at the bottom of the article. If anyone is interested, for a few pence I can fashion a tin-foil hat, which I can guarantee will be as effective. Luckily, Bad Science has come to the rescue, so I don't need to tackle this in exhaustive detail, but as I have responded to others in the Green Party on this issue before, I thought I might share my thoughts on the matter. Julia has responded to the outpouring of scorn from scientists, but her response that "Disconnecting my Wi-Fi made me feel better. End of. I don't need a degree in physics to work out if I feel well or ill" exactly highlights the problems with assessing public health issues or medical treatments on the basis of personal experience or anecdote.

One thing to highlight
(as Julia has correctly noted) is that with all the research in this area, skepticism is a virtue. Experience of the biases prevalent in the reporting of industry-sponsored pharmaceutical trials teaches us this, and the arena of electromagnetic radiation is no exception. A recent systematic review by Matthias Egger (who knows a thing or two about systematic reviews) found that studies sponsored by the telecomms industry are less likely to report significant effects of electromagnetic radiation. So don't take any of the conclusions of research in this area at face value!

My opinion is that some people might be sensitive to electromagnetic radiation from mobile phone masts or WiFi - but if it were a ubiquitous problem, then many more people would have reported problems. Anecdotally, I have Wireless broadband at home and I never get headaches or joint pain. I also regularly walk through WiFi hotspots with no noticeable symptoms. The problem with symptoms like headache, nausea etc. is that they are very non-specific, and can be psychological. An underlying condition may exist that causes migraine, but the symptoms may be misattributed to an external factor that happens to be present at the onset of the symptoms. I'd advise anyone experiencing a sudden onset of such symptoms to visit their GP (and not a naturopath).

There's a fair amount of evidence that strongly suggests that the symptoms experienced by those who believe that they are sensitive to electromagnetic radiation are not caused by that radiation. A systematic review by Simon Wessely (an editorial board member of BMC Psychiatry) found that "The symptoms described by "electromagnetic hypersensitivity" sufferers can be severe and are sometimes disabling. However, it has proved difficult to show under blind conditions that exposure to EMF can trigger these symptoms. This suggests that "electromagnetic hypersensitivity" is unrelated to the presence of EMF, although more research into this phenomenon is required".
A randomized provocation trial by the same authors (comparing those reporting EMR sensitivity to controls, and exposing some to mobile phone radiation, some to a carrier wave, and some to a sham exposure) found that "No evidence was found to indicate that people with self reported sensitivity to mobile phone signals are able to detect such signals or that they react to them with increased symptom severity. As sham exposure was sufficient to trigger severe symptoms in some participants, psychological factors may have an important role in causing this condition". Another systematic review by Prof Wessely and colleagues suggested that cognitive behaviour therapy may be useful for those reporting sensitivity to electromagnetic radiation.

As the experience of symptoms that patients associate with electromagnetic radiation exposure is likely to be psychological, this has possible implications for the precautionary principle. It has been argued that the precautionary principle, if coupled with overhyped warnings of risk, is potentially damaging: "Evidence is emerging that prior beliefs about the risks from modern technology are an important predictor of symptoms from perceived exposures. Thus, by distorting perceptions of risk, disproportionate precaution might paradoxically lead to illness that would not otherwise occur".

All this talk of electromagnetic radiation risks is very reminiscent of the fake documentary programme Brass Eye, and their take on 'Science'. This featured 'heavy electricity' caused by "particle accelerators sending huge jolts of power into domestic power lines... the devastating result is that huge masses of heavy electricity start randomly falling out of wires, and crashing on to anything below... Basically it is like getting hit by a ton of invisible lead soup". That pseudoscientific babble was read out (and believed) by the actor Richard Briers. If people will believe that, unfortunately they will believe anything.

10 May 2007

Journalology roundup #7

Scooped by a blog. A then PhD student Reed Cartwright came up with the same hypothesis on his blog as an accepted paper in Plant Cell, so the author offered him co-authorship on the paper. A nice feel-good story, but by Reed's admission "There are maybe three sentences in the published paper that I had anything to do with". I might be a spoil-sport, but I think that an acknowledgement would have made more sense! Reed's blog is here.

Physician-Industry Relationships. "Most physicians (94%) reported some type of relationship with the pharmaceutical industry, and most of these relationships involved receiving food in the workplace (83%) or receiving drug samples (78%). More than one third of the respondents (35%) received reimbursement for costs associated with professional meetings or continuing medical education, and more than one quarter (28%) received payments for consulting, giving lectures, or enrolling patients in trials".

The Scientist's take on the Shelley Batts figure reuse affair.

Characteristics Associated with Citation Rate of the Medical Literature. "Large trials, with group authorship, industry-funded, with industry-favoring results, in oncology or cardiology were associated with greater subsequent citations". This is the kind of journalology research I love to see!

Open Access & Science Publishing. Results of a Study on Researchers’ Acceptance and Use of Open Access Publishing

In the eye of the Open Access storm. "Publisher Matthew Cockerill is one of the father figures of open access. So, exactly how open is he?". A profile of our Dear Leader.

6 May 2007

Obscurity is a far greater threat to authors than piracy

Five years ago, Tim O'Reilly of Web 2.0 fame noted down several thoughts about online information distribution. Although his comments are focussed on music, film and book publishing, many of them equally apply to journal publishing.

My particular favourites are "Obscurity is a far greater threat to authors and creative artists than piracy", which captures the imperative of the open access movement, and "File sharing networks don't threaten book, music, or film publishing. They threaten existing publishers". This could have been written about self-archiving.

28 Apr 2007

What to do about late peer reviewers?

Editors and authors are left in the lurch when reviewers are late in returning their reports or even fail entirely to return a report. Although reviewers are usually volunteers, they have made a promise to the journal and their scientific colleagues, and the failure to return a report can greatly lengthen and complicate the review process.

Marc Hauser and Ernst Fehr writing in PLoS Biology have an idea of how to remedy this. "Reviewers that turn in their reviews late are punished, whereas those that arrive on time are rewarded". They suggest that "
for every day since receipt of the manuscript for review plus the number of days past the deadline, the reviewer's next personal submission to the journal will be held in editorial limbo for twice as long before it is sent for review" and "for every manuscript that a reviewer refuses to review, we add on a one-week delay to reviewing their own next submission".

I hate when reviewers are late, and it would be immensely satisfying to take revenge on them by snarling up their own submitted manuscripts, but I'm not sure that this is a workable system. It is true that journals can track the timeliness and helpfulness of reviewers - we do this at BioMed Central, so technical feasibility is not my objection.

Publishing is not a game; the aim is to get research checked and, if sound, published as quickly as possible. Deliberately adding in delays and checks both adds costs and impedes science. A publisher that started imposing such sanctions might lose those reviewers as both reviewers and authors, and introduce even more antagonism into what can already be a fraught process. This system would hit senior and well-known researchers the hardest, as they are most often asked to review and they simply can't agree to review every article sent to them. Reasons for declining would need to be distinguished - is someone who suggests a qualified and keen colleague deserving of sanction? What if they were inappropriate, or didn't even receive the email as it landed in their spam filter? What if they had a genuine reason that they were unable to return the report, such as the several reviewers in New Orleans at the time of Hurricane Katrina who were somewhat understandably late with their reports, or those suddenly falling ill or with a family emergency? What if they needed more time to complete a thorough reanalysis, as one of our editorial board members did recently?

What can we do instead? We already have a reviewer discount, such that reviewers who return their reports on time to a journal within the BMC series are entitled to a 20% discount on the article processing charge the next time (within a year) that they are the submitting author of a manuscript submitted to a journal in the series (i.e. BMC Bioinformatics, BMC Cancer etc.).

Editors can be ruthless. If an agreed reviewer is late, we may well make a decision without them if we already have reports in from other reviewers - if a reviewer doesn't want their time in reading the manuscript wasted and their opinions ignored, they should get the report in on time.


Fostering a good relationship with reviewers and authors helps. Authors who receive timely reviews will feel inclined to review quickly themselves. Authors who don't may well refuse to review until they have received a decision, the flip side of Hauser and Fehr's proposal. Equally, authors and reviewers need to remember that editors are human too. We sometimes receive a level of bad tempered abuse from authors that if we dished back out we'd be fired. A way to remind reviewers that we're human is to phone them - email can give the false impression that journals are run by robots, although we do find that email reminders can be very effective. A look at the statistics for the times that reviews are returned shows that most are returned within a day of us sending a reminder email letting the reviewer know that their report is due within three days.

If we respect each other and agree with the aim of efficiently and effectively assessing scientific research, we're all better off. I'm not sure that penalties are the best way to achieve this.

Journalology roundup #6

Plagiarism is not fair play. "I beg to differ with the view ... that non-English-speaking researchers' plagiarism of scientific text should be dealt with leniently". There has been quite a lot of discussion on the World Association of Medical Editors list about plagiarism - I agree that it cannot be tolerated.

Valid Consent for Genomic Epidemiology in Developing Countries. "we discuss the practical challenges of defining and obtaining valid consent for genomic epidemiological research in developing countries".

Mistakes and misconduct in the research literature: retractions just the tip of the iceberg. "I recently wrote a systematic review of studies (published between 1972 and 2005) of growth in children taking stimulant medication for attention deficit hyperactivity disorder (ADHD), and I was astounded by the poor quality of much of the research".

Controversial fertility paper retracted. After determining the article was "duplicated," Fertility and Sterility bars corresponding author, but not other co-authors, for three years.

Open access and the reuse of images

Pedro on Public Rambling has written about the reuse of scientific images and notes that the Creative Commons license used by both BioMed Central and PLoS allows him and other bloggers to freely post images from our journals without the need to laboriously fill out forms or the worry of facing legal action: “From a user point of view this is absolutely liberating. I can not only read these manuscripts but I can use their pictures to comment on them and I can even think of creatively combining their content with other works”. All that is needed is an acknowledgement of the source of the figures (this wasn't given when an article was published in Cytometry Part A, hence this erratum).

Pedro's comments were well placed.
Shelley Batts on Retrospectacle, reports that she had a “tangle with lawyers ... over the 'fair use' of a figure ... In short, I was threatened with legal action if I didn't take it down immediately. I used a panel a figure, and a chart, from over 10+ figures in the paper. I cited and reported everything straight forwardly. I would think they'd be happy to get the press. But alas, no”.

John Hawks has pointed out that unfortunately Wiley (the publisher in question) might be within their rights to argue that 'fair use' does not extend to posts on a blog on a commercial platform that carries advertising. Shelley initially redrew the figures after being contacted by Wiley, but a check of the Wiley permissions FAQs confirms that
“If you redraw a figure, you have created an adapted version of the original figure. You are still required to credit the original source. If the figure or figures you are redrawing exceed the limits of "fair use," you must request permission from the original source. Redrawing is not a way to by-pass copyright protection” (my emphasis).

Although Wiley has now backed down since the blogosphere exploded on this issue - a good summary is on A Blog Around The Clock - this confused picture of permissions and rights only goes to bolster the argument that traditional closed access publishing damages the dissemination and discussion of science.

Peter Suber has noted before that open access solves not just the 'serials crisis' on journal pricing, but also the 'permissions crisis'. Although Wiley allows self-archiving, the instinct and practice of traditional publishers is to limit the reuse of work published by them unless they give permission and receive payment. If you believe that scientific work should be communicated and debated without barriers, publish in an open access journal.

23 Apr 2007

Journalology roundup #5

Science retracts major Arabidopsis paper. "Scientist acknowledges omitting data, but denies any impropriety". Another paper and probably a career bites the dust.

The strike rate index: a new index for journal quality based on journal size and the h-index of citations. "The SRI explains more than four times the variation in citation counts compared to the impact factor". I've yet to read this properly, but it looks interesting. At some point we need to settle on some stable and useful alternatives to the Impact Factor. As an aside, I love Biomedical Digital Libaries! I would say that as it's a BioMed Central journal, but it's carving out a great niche, publishing some work of real interest to librarians, editors and others interested in scientometrics.

NEJM punishes reviewer for breaking embargo. "The New England Journal of Medicine has banned Martin Leon, a cardiologist at the Cardiovascular Research Foundation, from reviewing studies and contributing editorials or reviews for five years, as a punishment for telling colleagues at an American College of Cardiology symposium that a trial comparing medication to stents for the treatment of clogged coronaries "was rigged to fail-and it did." The data was to be presented two days later, and published in NEJM soon after". That seems a bit harsh! There are worse crimes than breaking an embargo. If journals published work online when it was ready rather than hoarding it for months to fill paper issues then there would be less temptation to break embargos. If it is through peer review, make it public without delay!



A bumper crop from the Cochrane Collaboration!

Editorial peer review for improving the quality of reports of biomedical studies. "Little empirical evidence is available to support the use of editorial peer review as a mechanism to ensure quality of biomedical research".

Time to publication for results of clinical trials. "Trials with positive results are published sooner than other trials".

Grey literature in meta-analyses of randomized trials of health care interventions. "Published trials tend to be larger and show an overall greater treatment effect than grey [unpublished] trials".

Full publication of results initially presented in abstracts. "Only 63% of results from abstracts describing randomized or controlled clinical trials are published in full. 'Positive' results were more frequently published than not 'positive' results. The consequence of this is that systematic reviews will tend to over-estimate treatment effects".

Technical editing of research reports in biomedical journals. "Most journals try to improve articles before publication by editing them to make them fit a 'house-style', and by other processes such as proof-reading... There is some evidence that the overall 'package' of technical editing raises the quality of articles (suggested by 'before-and-after' studies). However, there has been little rigorous research to show which processes can improve accuracy or readability the most, or if any have harmful effects". I'm a big fan of Liz Wager's work, she's one of the few out there really trying to test what editors and journals do.

20 Apr 2007

Archivangelism - has the means become the end?

Stevan Harnad has always been insistent on the need for immediate, free access to academic research, and he sees self-archiving as the means to this end.

Now that he recognises that self-archiving may only be compatible with some publishers if there is a delay in access, Stevan (who is normally uncompromising, e.g. "OA itself is non-negotiable") seems to have accepted this fudge, which is not immediate free access: "Access to the immediate deposit can then either be set as Open Access immediately, or (in case of a publisher embargo), as Closed Access, provisionally". This is the "Immediate-Deposit & Optional-Access" (IDOS) policy. Even with a fancy name, and as Jan Velterop has noted, it's not open access.

Stevan has been adamantly against the crystal-ball-gazing that predicts a loss in subscriptions resulting from self-archiving, but his own crystal ball predicts that following a universal adoption of 'IDOS' repositories, "Embargoes will disappear very soon thereafter" [my emphasis].

Stevan has criticised advocates of open access journals who claim that open access journals will reduce costs, as he insists that it is access that is paramount and not costs, which is a fair point. Yet he now criticises open access journals and hybrid journals for the extra costs he says they impose, for example criticising CERN's decision to put up funds to pay for article processing charges as "diverting scarce research funds from research to paying publishers". It seems that if open access journals might save costs, that's a side issue; if they might cost more, we should take heed.

While there might be issues with double-payment in hybrid journals, that can be corrected by adjusting subscription costs - it isn't an insurmountable issue. Further, open access journals don't have this problem, but Stevan's criticisms of Springer Open Choice don't often allow for this distinction. How open access can be paid for is open to debate - the debate has usually focussed on the article processing charge, but as Peter Suber has noted not all open access journals charge author fees. Costs can also be met using advertising (though hardly an uncontroversial way for a medical journal to recover costs), grants from societies (this is how the Beilstein Journal of Organic Chemistry is funded), charitable and philanthropic donations, or even by cutting costs. An interesting aspect of article processing charges is that they can result in price competition on an article-by-article basis.

Rather than being a system with no barriers to access (the definition of open access as I understand it), under self-archiving each author (having signed over copyright to the publisher) needs to deposit their articles in their local repository (if one exists), then each reader needs to realise that the repository exists, find the article, and then possibly have to contact the author to get a copy, and then have the author respond and send it to them. Sadly, this seems to be laborious, incomplete and prone to failure. I had thought that the launch of Google Scholar opened up the possibility of self-archiving really being viable, but their practice of linking to all copies of an article that could be found on the web only lasted a few short months and links to free versions are now intermittent - possibly (probably), Google were sat on by publishers.

Libraries will apparently continue to subscribe to journals that their users can access at no cost, despite evidence that libraries are acutely attuned to cost, and an existing trend of university actions against high journal prices. Publishers will apparently be happy to have a business model that depends on their customers paying for a product that can be obtained for free. This business model is actually seen in shareware, though shareware is much rarer now than 10 to 20 years ago, and certainly the music industry isn't too keen on this business model. If self-archiving doesn't cause a collapse in subscriptions to closed access journals, I'd suggest that it will implicitly have failed to achieve its goal. Surely the aim is to provide immediate free access to peer reviewed academic research - if libraries and readers are unaware that they could get what they are still paying for at no cost, might that not imply that self-archiving doesn't provide universal access? Might there be those who aren't paying and who don't realise that the research is accessible, and therefore never read the article? We need to end this farcical situation of researchers not reading articles, and although I like the idea of self-archiving I don't believe that if offers a complete enough solution, or is sustainable.

Stevan's insistence on self-archiving has even extended to criticising central deposit in PubMed Central, arguing that articles must only be deposited in institutional repositories. What is BioMed Central to do; stop depositing in PubMed Central? It's hardly as though we block our authors depositing in their own local repositories.


Stevan lays claim to being the true voice of open access. In responding to an article by Ben Goldacre he argued that "It is not "two [Gold] OA publishing organisations" that have led the fight for OA, but one (Green and Gold) organisation -- the same one that first coined the term OA in 2002: the
Budapest Open Access Initiative (BOAI)". Actually, it's not true that BOAI coined 'open access'.

Stevan at times appears to be entirely opposed to the idea of open access journals (despite apparently supporting the idea a decade ago), for example raising criticisms against BioMed Central as a publisher from the outset.

I can't agree with Stevan's insistence upon local institutional self-archiving to the apparent exclusion of other approaches to open access.
It appears to me that with archivangelism the means has become the end.