User login
A new preprint server for the medical and health sciences – medRxiv – has launched, along with safeguards designed to mitigate the risk of non–peer-reviewed findings prematurely guiding clinical practice or misinforming the public.
The new repository of preprints is intended for researcher-to-researcher communication – and mainly to facilitate faster sharing of research findings before publication in peer-reviewed journals. Papers will not be scrutinized for study design or the strength of the science, but they will be screened by an external clinical scientist and – at least for now – by an editor funded by BMJ, the London-based publisher and one of the three cofounding organizations of medRxiv (pronounced “med archive”).
The server’s six-person leadership team – comprising leaders from BMJ and cofounders, Cold Spring Harbor Laboratory in New York, and Yale University in New Haven, Conn. – will make final decisions about whether to post papers that generate concerns.
“We’ve put in place more stringent screening procedures than existed for bioRxiv, [a biological preprint server launched in 2013 by Cold Spring Harbor Laboratory],”said Theodora Bloom, PhD, executive editor of BMJ. “We’ll specifically ask the question, is there a risk to public health or health-related behaviors if this preprint is posted and [turns out to be] wrong?”
Concerns that poor information will be disseminated to the public or that the public will misinterpret information published, were heard by the medRxiv founders as they “work-shopped the idea and talked with the community,” said Joseph Ross, MD, an associate professor of medicine and public health at Yale and codirector of the Yale Open Data Access (YODA) Project
“We’re taking a cautious approach, particularly in the early days as we learn from the process,” he said. “How a paper [could potentially influence clinical practice] will be a guiding question.”
The cofounders had several conversations, Dr. Ross said, with Howard Bauchner, MD, editor in chief of JAMA, who took a strong stance against preprints and shortcutting the peer review process in a 2017 editorial titled “The rush to publication: An editorial and scientific mistake.” (Dr. Ross is an associate editor at JAMA Internal Medicine. Dr. Bauchner was unavailable for comment on the safeguards built into medRvix.)
Aaron D. Viny, MD, a hematologist-oncologist at Memorial Sloan Kettering in New York, said he has mixed feelings about preprints and believes the stakes are higher with medRvix, given that it will house clinical content – including, he anticipates, single-institution, nonprospective outcome studies of off-label drug uses. “These aren’t bona fide clinical trials and may not have the best data,” he said.
Still, there are advantages for investigators – and for the progress of research – with earlier dissemination of findings, Dr. Viny said. He recently had a paper posted on bioRvix for the first time. The paper was undergoing revision for a peer-reviewed journal and was being presented at a national meeting at the time it was posted.
“We timed it [as such], so that not only were we presenting it at a national meeting, but it also got more Twitter buzz,” he said. “I thought it was a good body of work, and I was excited to discuss it online with the scientific community.”
Dr. Viny’s decision is common among preprint authors and reflects the values of the preprint server, Dr. Ross said. “When people are reading or hearing about [new findings] at a meeting, they can go to the papers to get more complete information.” And, he said, the investigators themselves can get more feedback than they otherwise would.
In addition to papers that are well on their way to publication in peer-reviewed journals, Dr. Ross anticipates that medRvix will house papers on qualitative studies and observational research that face more arduous publication paths. He said he expects to see research on medical education and hopes to see papers on “quality improvement work, which typically involve small interventions at a single institution, and have important insights but are hard to publish because of generalizability and controls.”
And while there has been a “positive shift” in the past 10 years in the publication of negative results in peer-reviewed literature, medRvix may well capture studies that have negative results “because they have challenges with recruitment or other [elements of study design],” Dr. Ross said. “There is still a lot that can be learned by the scientific community from these negative studies, but they’re very difficult to publish in a peer-reviewed journal.”
Road to preprints
BMJ has a history with preprints. The publisher established a preprint server for biomedical research in the late 1990s, but it never took off and was shut down in the early 2000s. “It just didn’t get the uptake,” said Dr. Bloom. “It’s hard to know exactly why.”
What is clear, she said, is what has changed in the past 20 years: Copious use of the Internet overall, a growing desire to stake out one’s research turf online, requests from funders to have preprints listed on grant applications, and disease outbreaks involving the Zika virus and Ebola that have highlighted the advantages of faster dissemination of research findings.
BMJ had begun discussions with John Inglis, PhD, of Cold Spring Harbor Laboratory about launching a preprint server for the medical sciences (building on the experience of bioRxiv) when they heard Harlan Krumholz, MD, professor of medicine at Yale and head of the YODA project, speak at the 2017 meeting of the International Congress on Peer Review & Scientific Publication. In his keynote address, Dr. Krumholz described Yale’s plans to launch a preprint server.
“We all felt it would be better working together than apart,” Dr. Bloom said.
Getting published
Each preprint on medRxiv will get a permanent DOI link and a disclaimer stating that preprints are not peer reviewed, should not be relied on to guide clinical practice, and should not be reported in the news media as established information.
Authors will be required to meet various standards and requirements common in the clinical and medical sciences, such as including details on ethics approvals, patient consent, funding sources and conflicts of interest, and trial registration numbers. They will have the option of adding a revision(s) of their preprint (each preprint will have a “history”), as well as the option of having their preprint marked as “withdrawn” if they can no longer stand by the findings or conclusions. Preprints will automatically be linked to final published papers.
Journals have wrestled with how to handle preprints. A look at several major peer-reviewed journals shows that they’ll consider articles that have appeared in early form as preprints (including the New England Journal of Medicine, according to media relations manager Jennifer Zeis), but there are caveats. JAMA, for instance, will look at whether submitted manuscripts add “meaningfully new” information above what the preprint disseminated.
Similarly, the American Society of Clinical Oncology (ASCO) will consider how preprints affect the “novelty” of the manuscript’s findings for its ASCO journal readers. Editors of the journal Blood will consider “public comments or coverage about [the] preprint” in its evaluation of the manuscript’s impact. Several of the major journals specify that preprints cannot be updated while manuscripts are under review.
A recent review of bioRxiv preprints shows that approximately two-thirds went on to peer-reviewed publication.
And according to the BMJ’s Dr. Bloom, “there is definitely evidence that preprints [overall] are getting cited [in the scientific literature] before peer-reviewed articles appear.”
The server medRvix began accepting manuscripts on June 6 and will go live on June 25. It will accept only research papers – not commentaries or case reports, Dr. Ross emphasized.
For now, Dr. Bloom said, the most immediate and “real question for us is, will clinical researchers embrace preprints? And if they do, can we continue to provide a light touch but rapid way to screen papers while ensuring the safety of what we’re posting?”
For his part, Dr. Viny is bracing for “public consumption” of medRxiv content, especially in the oncology community in which patients are often extraordinarily well educated about their disease and determined to learn about all possible treatment options. “My job as a clinician,” he said, “will be to contextualize the patient’s reference information.”
A new preprint server for the medical and health sciences – medRxiv – has launched, along with safeguards designed to mitigate the risk of non–peer-reviewed findings prematurely guiding clinical practice or misinforming the public.
The new repository of preprints is intended for researcher-to-researcher communication – and mainly to facilitate faster sharing of research findings before publication in peer-reviewed journals. Papers will not be scrutinized for study design or the strength of the science, but they will be screened by an external clinical scientist and – at least for now – by an editor funded by BMJ, the London-based publisher and one of the three cofounding organizations of medRxiv (pronounced “med archive”).
The server’s six-person leadership team – comprising leaders from BMJ and cofounders, Cold Spring Harbor Laboratory in New York, and Yale University in New Haven, Conn. – will make final decisions about whether to post papers that generate concerns.
“We’ve put in place more stringent screening procedures than existed for bioRxiv, [a biological preprint server launched in 2013 by Cold Spring Harbor Laboratory],”said Theodora Bloom, PhD, executive editor of BMJ. “We’ll specifically ask the question, is there a risk to public health or health-related behaviors if this preprint is posted and [turns out to be] wrong?”
Concerns that poor information will be disseminated to the public or that the public will misinterpret information published, were heard by the medRxiv founders as they “work-shopped the idea and talked with the community,” said Joseph Ross, MD, an associate professor of medicine and public health at Yale and codirector of the Yale Open Data Access (YODA) Project
“We’re taking a cautious approach, particularly in the early days as we learn from the process,” he said. “How a paper [could potentially influence clinical practice] will be a guiding question.”
The cofounders had several conversations, Dr. Ross said, with Howard Bauchner, MD, editor in chief of JAMA, who took a strong stance against preprints and shortcutting the peer review process in a 2017 editorial titled “The rush to publication: An editorial and scientific mistake.” (Dr. Ross is an associate editor at JAMA Internal Medicine. Dr. Bauchner was unavailable for comment on the safeguards built into medRvix.)
Aaron D. Viny, MD, a hematologist-oncologist at Memorial Sloan Kettering in New York, said he has mixed feelings about preprints and believes the stakes are higher with medRvix, given that it will house clinical content – including, he anticipates, single-institution, nonprospective outcome studies of off-label drug uses. “These aren’t bona fide clinical trials and may not have the best data,” he said.
Still, there are advantages for investigators – and for the progress of research – with earlier dissemination of findings, Dr. Viny said. He recently had a paper posted on bioRvix for the first time. The paper was undergoing revision for a peer-reviewed journal and was being presented at a national meeting at the time it was posted.
“We timed it [as such], so that not only were we presenting it at a national meeting, but it also got more Twitter buzz,” he said. “I thought it was a good body of work, and I was excited to discuss it online with the scientific community.”
Dr. Viny’s decision is common among preprint authors and reflects the values of the preprint server, Dr. Ross said. “When people are reading or hearing about [new findings] at a meeting, they can go to the papers to get more complete information.” And, he said, the investigators themselves can get more feedback than they otherwise would.
In addition to papers that are well on their way to publication in peer-reviewed journals, Dr. Ross anticipates that medRvix will house papers on qualitative studies and observational research that face more arduous publication paths. He said he expects to see research on medical education and hopes to see papers on “quality improvement work, which typically involve small interventions at a single institution, and have important insights but are hard to publish because of generalizability and controls.”
And while there has been a “positive shift” in the past 10 years in the publication of negative results in peer-reviewed literature, medRvix may well capture studies that have negative results “because they have challenges with recruitment or other [elements of study design],” Dr. Ross said. “There is still a lot that can be learned by the scientific community from these negative studies, but they’re very difficult to publish in a peer-reviewed journal.”
Road to preprints
BMJ has a history with preprints. The publisher established a preprint server for biomedical research in the late 1990s, but it never took off and was shut down in the early 2000s. “It just didn’t get the uptake,” said Dr. Bloom. “It’s hard to know exactly why.”
What is clear, she said, is what has changed in the past 20 years: Copious use of the Internet overall, a growing desire to stake out one’s research turf online, requests from funders to have preprints listed on grant applications, and disease outbreaks involving the Zika virus and Ebola that have highlighted the advantages of faster dissemination of research findings.
BMJ had begun discussions with John Inglis, PhD, of Cold Spring Harbor Laboratory about launching a preprint server for the medical sciences (building on the experience of bioRxiv) when they heard Harlan Krumholz, MD, professor of medicine at Yale and head of the YODA project, speak at the 2017 meeting of the International Congress on Peer Review & Scientific Publication. In his keynote address, Dr. Krumholz described Yale’s plans to launch a preprint server.
“We all felt it would be better working together than apart,” Dr. Bloom said.
Getting published
Each preprint on medRxiv will get a permanent DOI link and a disclaimer stating that preprints are not peer reviewed, should not be relied on to guide clinical practice, and should not be reported in the news media as established information.
Authors will be required to meet various standards and requirements common in the clinical and medical sciences, such as including details on ethics approvals, patient consent, funding sources and conflicts of interest, and trial registration numbers. They will have the option of adding a revision(s) of their preprint (each preprint will have a “history”), as well as the option of having their preprint marked as “withdrawn” if they can no longer stand by the findings or conclusions. Preprints will automatically be linked to final published papers.
Journals have wrestled with how to handle preprints. A look at several major peer-reviewed journals shows that they’ll consider articles that have appeared in early form as preprints (including the New England Journal of Medicine, according to media relations manager Jennifer Zeis), but there are caveats. JAMA, for instance, will look at whether submitted manuscripts add “meaningfully new” information above what the preprint disseminated.
Similarly, the American Society of Clinical Oncology (ASCO) will consider how preprints affect the “novelty” of the manuscript’s findings for its ASCO journal readers. Editors of the journal Blood will consider “public comments or coverage about [the] preprint” in its evaluation of the manuscript’s impact. Several of the major journals specify that preprints cannot be updated while manuscripts are under review.
A recent review of bioRxiv preprints shows that approximately two-thirds went on to peer-reviewed publication.
And according to the BMJ’s Dr. Bloom, “there is definitely evidence that preprints [overall] are getting cited [in the scientific literature] before peer-reviewed articles appear.”
The server medRvix began accepting manuscripts on June 6 and will go live on June 25. It will accept only research papers – not commentaries or case reports, Dr. Ross emphasized.
For now, Dr. Bloom said, the most immediate and “real question for us is, will clinical researchers embrace preprints? And if they do, can we continue to provide a light touch but rapid way to screen papers while ensuring the safety of what we’re posting?”
For his part, Dr. Viny is bracing for “public consumption” of medRxiv content, especially in the oncology community in which patients are often extraordinarily well educated about their disease and determined to learn about all possible treatment options. “My job as a clinician,” he said, “will be to contextualize the patient’s reference information.”
A new preprint server for the medical and health sciences – medRxiv – has launched, along with safeguards designed to mitigate the risk of non–peer-reviewed findings prematurely guiding clinical practice or misinforming the public.
The new repository of preprints is intended for researcher-to-researcher communication – and mainly to facilitate faster sharing of research findings before publication in peer-reviewed journals. Papers will not be scrutinized for study design or the strength of the science, but they will be screened by an external clinical scientist and – at least for now – by an editor funded by BMJ, the London-based publisher and one of the three cofounding organizations of medRxiv (pronounced “med archive”).
The server’s six-person leadership team – comprising leaders from BMJ and cofounders, Cold Spring Harbor Laboratory in New York, and Yale University in New Haven, Conn. – will make final decisions about whether to post papers that generate concerns.
“We’ve put in place more stringent screening procedures than existed for bioRxiv, [a biological preprint server launched in 2013 by Cold Spring Harbor Laboratory],”said Theodora Bloom, PhD, executive editor of BMJ. “We’ll specifically ask the question, is there a risk to public health or health-related behaviors if this preprint is posted and [turns out to be] wrong?”
Concerns that poor information will be disseminated to the public or that the public will misinterpret information published, were heard by the medRxiv founders as they “work-shopped the idea and talked with the community,” said Joseph Ross, MD, an associate professor of medicine and public health at Yale and codirector of the Yale Open Data Access (YODA) Project
“We’re taking a cautious approach, particularly in the early days as we learn from the process,” he said. “How a paper [could potentially influence clinical practice] will be a guiding question.”
The cofounders had several conversations, Dr. Ross said, with Howard Bauchner, MD, editor in chief of JAMA, who took a strong stance against preprints and shortcutting the peer review process in a 2017 editorial titled “The rush to publication: An editorial and scientific mistake.” (Dr. Ross is an associate editor at JAMA Internal Medicine. Dr. Bauchner was unavailable for comment on the safeguards built into medRvix.)
Aaron D. Viny, MD, a hematologist-oncologist at Memorial Sloan Kettering in New York, said he has mixed feelings about preprints and believes the stakes are higher with medRvix, given that it will house clinical content – including, he anticipates, single-institution, nonprospective outcome studies of off-label drug uses. “These aren’t bona fide clinical trials and may not have the best data,” he said.
Still, there are advantages for investigators – and for the progress of research – with earlier dissemination of findings, Dr. Viny said. He recently had a paper posted on bioRvix for the first time. The paper was undergoing revision for a peer-reviewed journal and was being presented at a national meeting at the time it was posted.
“We timed it [as such], so that not only were we presenting it at a national meeting, but it also got more Twitter buzz,” he said. “I thought it was a good body of work, and I was excited to discuss it online with the scientific community.”
Dr. Viny’s decision is common among preprint authors and reflects the values of the preprint server, Dr. Ross said. “When people are reading or hearing about [new findings] at a meeting, they can go to the papers to get more complete information.” And, he said, the investigators themselves can get more feedback than they otherwise would.
In addition to papers that are well on their way to publication in peer-reviewed journals, Dr. Ross anticipates that medRvix will house papers on qualitative studies and observational research that face more arduous publication paths. He said he expects to see research on medical education and hopes to see papers on “quality improvement work, which typically involve small interventions at a single institution, and have important insights but are hard to publish because of generalizability and controls.”
And while there has been a “positive shift” in the past 10 years in the publication of negative results in peer-reviewed literature, medRvix may well capture studies that have negative results “because they have challenges with recruitment or other [elements of study design],” Dr. Ross said. “There is still a lot that can be learned by the scientific community from these negative studies, but they’re very difficult to publish in a peer-reviewed journal.”
Road to preprints
BMJ has a history with preprints. The publisher established a preprint server for biomedical research in the late 1990s, but it never took off and was shut down in the early 2000s. “It just didn’t get the uptake,” said Dr. Bloom. “It’s hard to know exactly why.”
What is clear, she said, is what has changed in the past 20 years: Copious use of the Internet overall, a growing desire to stake out one’s research turf online, requests from funders to have preprints listed on grant applications, and disease outbreaks involving the Zika virus and Ebola that have highlighted the advantages of faster dissemination of research findings.
BMJ had begun discussions with John Inglis, PhD, of Cold Spring Harbor Laboratory about launching a preprint server for the medical sciences (building on the experience of bioRxiv) when they heard Harlan Krumholz, MD, professor of medicine at Yale and head of the YODA project, speak at the 2017 meeting of the International Congress on Peer Review & Scientific Publication. In his keynote address, Dr. Krumholz described Yale’s plans to launch a preprint server.
“We all felt it would be better working together than apart,” Dr. Bloom said.
Getting published
Each preprint on medRxiv will get a permanent DOI link and a disclaimer stating that preprints are not peer reviewed, should not be relied on to guide clinical practice, and should not be reported in the news media as established information.
Authors will be required to meet various standards and requirements common in the clinical and medical sciences, such as including details on ethics approvals, patient consent, funding sources and conflicts of interest, and trial registration numbers. They will have the option of adding a revision(s) of their preprint (each preprint will have a “history”), as well as the option of having their preprint marked as “withdrawn” if they can no longer stand by the findings or conclusions. Preprints will automatically be linked to final published papers.
Journals have wrestled with how to handle preprints. A look at several major peer-reviewed journals shows that they’ll consider articles that have appeared in early form as preprints (including the New England Journal of Medicine, according to media relations manager Jennifer Zeis), but there are caveats. JAMA, for instance, will look at whether submitted manuscripts add “meaningfully new” information above what the preprint disseminated.
Similarly, the American Society of Clinical Oncology (ASCO) will consider how preprints affect the “novelty” of the manuscript’s findings for its ASCO journal readers. Editors of the journal Blood will consider “public comments or coverage about [the] preprint” in its evaluation of the manuscript’s impact. Several of the major journals specify that preprints cannot be updated while manuscripts are under review.
A recent review of bioRxiv preprints shows that approximately two-thirds went on to peer-reviewed publication.
And according to the BMJ’s Dr. Bloom, “there is definitely evidence that preprints [overall] are getting cited [in the scientific literature] before peer-reviewed articles appear.”
The server medRvix began accepting manuscripts on June 6 and will go live on June 25. It will accept only research papers – not commentaries or case reports, Dr. Ross emphasized.
For now, Dr. Bloom said, the most immediate and “real question for us is, will clinical researchers embrace preprints? And if they do, can we continue to provide a light touch but rapid way to screen papers while ensuring the safety of what we’re posting?”
For his part, Dr. Viny is bracing for “public consumption” of medRxiv content, especially in the oncology community in which patients are often extraordinarily well educated about their disease and determined to learn about all possible treatment options. “My job as a clinician,” he said, “will be to contextualize the patient’s reference information.”