Transparent and accurate reporting increases reliability, utility, and impact of your research: reporting guidelines and the EQUATOR Network
© Simera et al; licensee BioMed Central Ltd. 2010
Received: 9 April 2010
Accepted: 26 April 2010
Published: 26 April 2010
Although current electronic methods of scientific publishing offer increased opportunities for publishing all research studies and describing them in sufficient detail, health research literature still suffers from many shortcomings. These shortcomings seriously undermine the value and utility of the literature and waste scarce resources invested in the research. In recent years there have been several positive steps aimed at improving this situation, such as a strengthening of journals' policies on research publication and the wide requirement to register clinical trials.
The EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network is an international initiative set up to advance high quality reporting of health research studies; it promotes good reporting practices including the wider implementation of reporting guidelines. EQUATOR provides free online resources http://www.equator-network.org supported by education and training activities and assists in the development of robust reporting guidelines. This paper outlines EQUATOR's goals and activities and offers suggestions for organizations and individuals involved in health research on how to strengthen research reporting.
Scholarly publishing is undoubtedly undergoing a revolution that has brought not only new ways of disseminating research information but also a more critical perspective on assessing published information. Some of these changes are driven by the new technologies; others have occurred as a response to the shortcomings of scholarly publishing such as difficulty of accessing published research or obtaining sufficient information from the published text. Journals remain the core of research communication but the way that this is now done has been transformed. The vast majority of scientific journals, including those publishing health research papers, are now available online . This allows the supplementing of research articles with additional information or data, showing pre-publication history or readers' comments on the published research. Some of these features have been facilitated by open access publishing, which has grown from a brave experiment into a highly regarded and frequently used publication method. In recent years we have also seen a growing awareness of ethical issues and an acknowledgement of widespread problems influencing the reliability of the published medical research literature [2–5]. Such problems also extend to the process of manuscripts' peer review .
Some journals have taken steps to improve the quality of the research they publish. These include improving their instructions to authors [7–9], introducing new thematic sections for articles on research methodology and guidance [10, 11] and a requirement to register clinical trials  or deposit data into public repositories [7, 13].
All these new trends have the potential to contribute to an increased transparency in health research publishing. However, despite these initiatives many problems in the research literature still prevail. In this article we will focus on the inadequate quality of reporting of health research and highlight current initiatives to improve the situation.
How reliable are published reports of health research?
A growing body of methodological research reviewing the published literature highlights a variety of shortcomings in health research publications. Appendix 1 lists some of those problems. Such deficiencies make it difficult, or impossible, to assess how the research was conducted, to evaluate the reliability of the presented findings or to place them in the context of existing research evidence. As a result published studies often cannot be used by clinicians in patients' care  or to inform public health policy . The preferential publication of positive results leads to an overestimation of the benefits of new therapies, which may lead to increased costs without a corresponding improvement in patient outcomes . Non-publication, or biased reporting of research findings, may indirectly harm patients including those involved in future research . Particularly problematic and unethical is the insufficient or misleading reporting of adverse events (harms) in randomized trials .
What is being done to improve the reporting of health research?
Some of these problems can be addressed by the wider and more consistent use of reporting guidelines. Reporting guidelines provide advice on how to report research methods and findings. Usually in the form of a checklist, a flow diagram or explicit text, they specify a minimum set of items required for a clear and transparent account of what was done and what was found in a research study - reflecting, in particular, issues that might introduce bias into the research. Most robust and widely recognized guidelines have been developed systematically; they incorporate relevant available evidence and reflect consensus opinion of experts in a particular field, including research methodologists and journal editors . Reporting guidelines complement general advice on the basic principles of scientific writing and specific journals' instructions to authors [18, 19].
Reporting guidelines for the main study types. More than 90 reporting guidelines are included in the EQUATOR Network's online Library for Health Research Reporting at http://www.equator-network.org/.
Diagnostic accuracy studies
Systematic reviews and meta-analyses
Quality improvement studies
There is growing evidence that use of a checklist - a core part of a reporting guideline - is a beneficial tool. For example, within surgery the use of a checklist was associated with saving lives and reducing morbidity .
The EQUATOR Network: helping to improve research reports
The EQUATOR Network (Enhancing the QUAlity and Transparency Of health Research) is an international initiative set up to help improve the reliability and value of health literature by promoting responsible reporting of health research [4, 26].
Appendix 2 summarizes the major goals of the EQUATOR Network. The main focus is on dissemination of the basic principles of responsible research reporting and the wider implementation of reporting guidelines. The EQUATOR website provides an up to date centralized resource for: researchers writing up their studies (notably guidance on reporting, scientific writing, ethical conduct in research and publication); for peer reviewers assessing research manuscripts; for editors who wish to implement policies to aid accurate and transparent research reporting in their journals; and also for scientists wishing to develop further high quality reporting guidelines http://www.equator-network.org/. Recently, we published an overview of our online resources and a summary of available guidelines to allow better dissemination of this information . Every 3 months we issue an online newsletter highlighting new reporting guidelines and other information relevant to responsible reporting. Our website statistics indicate a steadily growing global interest in these resources.
EQUATOR workshops developed by our team support the use of resources available on our website. They focus on journal editors as 'quality gatekeepers' but also on young researchers and research students in order to introduce good research reporting habits early in their scientific careers . The work of journal editors and peer reviewers is difficult and an improvement in the quality of submitted manuscripts would ease the peer review process and reduce the number of problems that currently elude editorial and peer review checks .
The EQUATOR programme is very young and there are important areas of work that we still need to tackle. These include:
Strengthening the methodology for the development and assessment of reporting guidelines
Investigating the barriers and facilitators of reporting guideline use
Increasing the awareness of the EQUATOR Network and the available resources worldwide and supporting the implementation of activities leading to better reporting of health research
It would be valuable to have generic reporting guidelines for all the main study types. These could then be implemented in specific areas of health research methodology and, if necessary, extended to, for example, address issues specific to clinical specialties. Harmonizing terminology, definitions of outcome measures and adverse effects seems to be next logical step to allowing better comparison across studies [28–30]. Well developed reporting guidelines have the potential to improve the clarity, completeness and transparency of research publications. Such publications can help us to gain the maximum value from funded research and may save lives and reduce the burden of illness on patients and costs to the healthcare system. Clearly, the reporting guidelines themselves must be robustly developed and should observe the same good reporting principles when presenting recommendations to their potential users. Drawing on our experience in the development of many reporting guidelines, members of the EQUATOR team recently published 'Guidance for Developers of Health Research Reporting Guidelines' .
We plan also to develop a reporting guideline assessment tool, similar in principle to the AGREE Instrument for clinical practice guidelines . Our systematic review  revealed important differences among the available guidelines. An evaluation of reporting guidelines in relation to identified criteria of importance would help journal editors to choose the most suitable guidelines for their journal and to request an appropriate level of compliance.
The EQUATOR team is investigating the factors that prevent or facilitate the use of reporting guidelines; this work will be very helpful in formulating a strategy for better dissemination and routine implementation of the guidelines in practice. Meanwhile, we offer some advice and practical tips on how to promote accurate and transparent reporting and the wider use of reporting guidelines. Appendix 3 provides a summary; more details are on the EQUATOR website.
The way that readers seek, access and read articles has also changed. Readers are more likely to search for a specific article rather than browse through journal issues. They read more articles per year but spend less time on individual articles . Readers do not have the time to try to work out what happened in a study and they should not have to. Authors must recognize the importance of clarity, structured format, logical flow of information and the key elements that should be reported; they should make it easy for readers to find the important information in their article. Peer reviewers should also take account of these principles when reviewing a manuscript.
It is important to increase awareness of the current poor level of reporting in the health research literature. Poor reporting may generally reflect an author's insufficient knowledge of good reporting practices and the reader's needs rather than deliberate attempts to mislead the readership. Whatever the reasons, it needs to be widely acknowledged that poor reporting is unacceptable. In this regard, we hope to assist by achieving increased awareness of the EQUATOR programme and our accumulated resources worldwide.
The STM overview of scientific and scholarly journal publishing  shows that, despite a huge change in the way journals are published, researchers' core motivations for publishing have remained largely unchanged, focussing on securing funding and furthering their careers. We appeal to researchers, peer reviewers, journal editors, research institutions and funding agencies to consider how, and by whom, their research articles will be used and to consider whether the final papers meet the needs of these potential users. Using reporting guidelines checklists in writing and peer reviewing will increase the completeness, clarity and transparency of research papers without restricting researchers' creativity.
The available guidelines can help to raise the standard of research reporting but they need to be supported by the researcher's prior knowledge of the principles of good research conduct and reporting, ethical issues related to research and publication and basics of clear scientific writing. Many journals already champion the cause for a better quality of research reporting; however, others need to follow this path or take a more progressive lead. We all need to recognize that endorsement does not automatically translate into adherence. In order to truly change the reporting culture, everyone involved in the process of research and its publication needs to participate. Journals have a major role to play but, in addition, academic and other research organizations, funders and regulatory bodies need to become much more proactive in order to ensure that the exchange of research information is accurate, complete and transparent.
Shortcomings in health research reporting
The following practices cause major concern:
Omissions or misinterpretation of results in abstracts 
Seven major goals of the EQUATOR Network
Develop and maintain a comprehensive internet-based resource centre providing up-to-date information, tools and other materials related to health research reporting
Assist in the development, dissemination and implementation of robust reporting guidelines
Actively promote the use of reporting guidelines and good research reporting practices through an education and training programme
Conduct regular assessments of how journals implement and use reporting guidelines
Conduct regular audits of the reporting quality across the whole spectrum of health research literature
Set up a global network of local EQUATOR collaborating centres in order to facilitate the improvement of health research reporting on a worldwide scale
Develop a general strategy for translating the principles of responsible research reporting into practice.
Steps to consider in order to support and practice accurate and transparent reporting of health research studies and promote the available resources
Incorporate an explicit philosophy of transparent, complete and accurate reporting and the use of reporting guidelines into your organizational strategy/editorial policy
Explore the available reporting guidelines; select well-developed guidelines appropriate for the reporting of research studies published in your journal
Ask or instruct authors to adhere to these guidelines and motivate their use
Ask or instruct peer reviewers to use the appropriate reporting guidelines when assessing manuscripts
Refer to the EQUATOR Network website in your 'Instructions to Authors'.
Inform your members of the existence of EQUATOR and its compiled online resources
Refer to the EQUATOR Network and its resources on your website.
Research funding organizations
Require accurate, complete and transparent reporting of the projects that you fund
Alert researchers to available reporting guidelines and motivate their use
Refer to the EQUATOR Network and its resources on your website.
Academic and other research institutions
Promote and support accurate and transparent reporting of health research studies and the use of reporting guidelines through your policies, resources and educational activities
Set aside resources to develop educational activities on reporting and peer reviewing research
Consider the options of introducing education on good research reporting practice: incorporate in existing courses; include in 'research integrity' education; organize stand alone workshops developing reporting skills (online or face-to-face); organize seminars and talks highlighting the importance of accurate research reporting; include information about research reporting policies and EQUATOR resources in welcome pack for new research staff; and so on
Refer to the EQUATOR Network and its resources on your website
Display promotional materials available on the EQUATOR website introducing reporting guidelines and other resources (for example, in research departments; health research libraries, and so on).
Reporting guidelines developers
Inform EQUATOR about your planned guideline development in order to avoid duplication and confusion.
Authors of research articles
Find out about reporting requirements early when planning your research study
When writing up your research, check the EQUATOR website for any new relevant guidelines in order to help improve the quality of your manuscript
Adhere to the relevant reporting guideline(s); when not reporting on certain items explain the reason why. Remember that reporting guidelines provide a minimum set of items; other details specific to your particular study might be relevant for a clear and complete account of what was done and found (consider, in particular, items that might have introduced bias into your research). It is important to provide enough information to allow your study to be potentially reproducible by others.
The EQUATOR Network is supported by the UK NHS National Institute for Health Research, UK Medical Research Council, Scottish Chief Scientist Office and Canadian Institutes of Health Research. We would like to thank to these funding bodies for providing vital financial support, without which this programme would not have been able to start or to continue its development.
Professor Altman is supported by Cancer Research UK, Dr Moher by a University of Ottawa Research Chair and Dr Schulz by Family Health International.
None of the above funders influenced in any way the content of this article.
- Ware M, Mabe M: The STM report: an overview of scientific and scholarly journals publishing. 2009, (Accessed 30 March 2010), [http://www.stm-assoc.org/news.php?id=255&PHPSESSID=3c5575d0663c0e04a4600d7f04afe91f]Google Scholar
- Martinson BC, Anderson MS, de Vries R: Scientists behaving badly. Nature. 2005, 435: 737-738. 10.1038/435737a.View ArticlePubMedGoogle Scholar
- Ioannidis JP: Why most published research findings are false. PLoS Med. 2005, 2: e124-10.1371/journal.pmed.0020124.View ArticlePubMedPubMed CentralGoogle Scholar
- Moher D, Simera I, Schulz K, Hoey J, Altman D: Helping editors, peer reviewers and authors improve the clarity, completeness and transparency of reporting health research. BMC Med. 2008, 6: 13-10.1186/1741-7015-6-13.View ArticlePubMedPubMed CentralGoogle Scholar
- Song F, Parekh S, Hooper L, Loke YK, Ryder J, Sutton AJ, Hing C, Kwok CS, Pang C, Harvey I: Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess. 2010, 14: iii, ix-iii,193Google Scholar
- Ioannidis JP, Tatsioni A, Karassa FB: Who is afraid of reviewers' comments? Or, why anything can be published and anything can be cited. Eur J Clin Invest. 2010, 40: 285-287. 10.1111/j.1365-2362.2010.02272.x.View ArticlePubMedGoogle Scholar
- BMC Medicine: Instructions to authors. (Accessed 30 March 2010)., [http://0-www.biomedcentral.com.brum.beds.ac.uk/bmcmed/ifora/]
- Roberts J: Reporting policies and Headache. Headache. 2010, 50: 345-347. 10.1111/j.1526-4610.2010.01612.x.View ArticleGoogle Scholar
- Ioannidis JP, Tatsioni A, Karassa FB: A vision for the European Journal of Clinical Investigation: note from the new editors. Eur J Clin Invest. 2010, 40: 1-3. 10.1111/j.1365-2362.2009.02229.x.View ArticlePubMedGoogle Scholar
- Groves T: Research methods and reporting. BMJ. 2008, 337: a2201-10.1136/bmj.a2201.View ArticleGoogle Scholar
- PLoS Medicine Editors: Better reporting, better research: guidelines and guidance in PLoS Medicine. PLoS Med. 2008, 5: e99-10.1371/journal.pmed.0050099.View ArticleGoogle Scholar
- Clinical trial registration: a statement from the International Committee of Medical Journal Editors. (Accessed 30 March 2010), [http://www.icmje.org/clin_trial.pdf]
- PLoS Medicine: Guidelines for authors. (Accessed 30 March 2010), [http://www.plosmedicine.org/static/guidelines.action]
- Glasziou P, Meats E, Heneghan C, Shepperd S: What is missing from descriptions of treatment in trials and reviews?. BMJ. 2008, 336: 1472-1474. 10.1136/bmj.39590.732037.47.View ArticlePubMedPubMed CentralGoogle Scholar
- Ahmad N, Boutron I, Dechartres A, Durieux P, Ravaud P: Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review. Trials. 2010, 11: 20-10.1186/1745-6215-11-20.View ArticlePubMedPubMed CentralGoogle Scholar
- Ioannidis JP: Adverse events in randomized trials: neglected, restricted, distorted and silenced. Arch Intern Med. 2009, 169: 1737-1739. 10.1001/archinternmed.2009.313.View ArticlePubMedGoogle Scholar
- Moher D, Simera I, Schulz K, Miller D, Grimshaw J, Hoey J, Altman DG: Reporting Guidelines for Clinical Research: A Systematic Review. 6th International Congress on Peer Review and Biomedical Publication, Vancouver. (Accessed 30 March 2010), [http://www.ama-assn.org/public/peer/abst?racts-0912.pdf]
- Moher D, Schulz KF, Simera I, Altman DG: Guidance for developers of health research reporting guidelines. PLoS Med. 2010, 7: e1000217-10.1371/journal.pmed.1000217.View ArticlePubMedPubMed CentralGoogle Scholar
- EQUATOR Network website: Introduction to reporting guidelines. (Accessed 30 March 2010), [http://www.equator-network.org/resource-centre/library-of-health-research-reporting/reporting-guidelines/introduction-to-reporting-guidelines/]
- Simera I, Moher D, Hoey J, Schulz KF, Altman DG: A catalogue of reporting guidelines for health research. Eur J Clin Invest. 2010, 40: 35-53. 10.1111/j.1365-2362.2009.02234.x.View ArticlePubMedGoogle Scholar
- Smidt N, Rutjes AW, Windt van der DA, Ostelo RW, Bossuyt PM, Reitsma JB, Bouter LM, de Vet HC: The quality of diagnostic accuracy studies since the STARD statement: has it improved?. Neurology. 2006, 67: 792-797. 10.1212/01.wnl.0000238386.41398.30.View ArticlePubMedGoogle Scholar
- Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I: Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006, 185: 263-267.PubMedGoogle Scholar
- Hopewell S, Altman DG, Moher D, Schulz KF: Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal 'Instructions to Authors'. Trials. 2008, 9: 20-10.1186/1745-6215-9-20.View ArticlePubMedPubMed CentralGoogle Scholar
- Meerpohl JJ, Wolff RF, Niemeyer CM, Antes G, von Elm E: Editorial policies of pediatric journals: survey of instructions for authors. Arch Pediatr Adolesc Med. 2010, 164: 268-272. 10.1001/archpediatrics.2009.287.View ArticlePubMedGoogle Scholar
- Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AH, Dellinger EP, Herbosa T, Joseph S, Kibatala PL, Lapitan MC, Safe Surgery Saves Lives Study Group, et al: A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009, 360: 491-499. 10.1056/NEJMsa0810119.View ArticlePubMedGoogle Scholar
- Altman DG, Simera I, Hoey J, Moher D, Schulz K: EQUATOR: reporting guidelines for health research. Lancet. 2008, 371: 1149-1150. 10.1016/S0140-6736(08)60505-X.View ArticlePubMedGoogle Scholar
- EQUATOR Network workshops - slides. (Accessed 30 March 2010), [http://www.equator-network.org/courses-events/equator-events/]
- Videnovic A, Metman LV: Deep brain stimulation for Parkinson's disease: prevalence of adverse events and need for standardized reporting. Mov Disord. 2008, 23: 343-349. 10.1002/mds.21753.View ArticlePubMedGoogle Scholar
- Chowers MY, Gottesman BS, Leibovici L, Pielmeier U, Andreassen S, Paul M: Reporting of adverse events in randomized controlled trials of highly active antiretroviral therapy: systematic review. J Antimicrob Chemother. 2009, 64: 239-250. 10.1093/jac/dkp191.View ArticlePubMedGoogle Scholar
- The COMET Initiative: BMJ blog 8. 2010, (Accessed 30 March 2010), [http://0-blogs.bmj.com.brum.beds.ac.uk/bmj/2010/03/08/the-comet-initiative/] March.
- AGREE website. (Accessed 30 March 2010), [http://www.agreecollaboration.org/]
- Hopewell S, Loudon K, Clarke MJ, Oxman AD, Dickersin K: Publication bias in clinical trials due to statistical significance or direction of trial results. Cochrane Database Syst Rev. 2009, 1: MR000006.PubMedGoogle Scholar
- Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan AW, Cronin E, Decullier E, Easterbrook PJ, von Elm E, Gamble C, et al: Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS One. 2008, 3: e3081-10.1371/journal.pone.0003081.View ArticlePubMedPubMed CentralGoogle Scholar
- Kirkham JJ, Dwan KM, Altman DG, Gamble C, Dodd S, Smyth R, Williamson PR: The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ. 2010, 340: c365-10.1136/bmj.c365.View ArticlePubMedGoogle Scholar
- Chan AW, Altman DG: Epidemiology and reporting of randomised trials published in PubMed journals. Lancet. 2005, 365: 1159-1162. 10.1016/S0140-6736(05)71879-1.View ArticlePubMedGoogle Scholar
- Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG: Epidemiology and reporting characteristics of systematic reviews. Plos Med. 2007, 4: e78-10.1371/journal.pmed.0040078.View ArticlePubMedPubMed CentralGoogle Scholar
- Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, CONSORT Group: CONSORT for reporting randomized controlled trials in journal and conference abstracts: explanation and elaboration. PLoS Med. 2008, 5: e20-10.1371/journal.pmed.0050020.View ArticlePubMedPubMed CentralGoogle Scholar
- Pitrou I, Boutron I, Ahmad N, Ravaud P: Reporting of safety results in published reports of randomized controlled trials. Arch Intern Med. 2009, 169: 1756-1761. 10.1001/archinternmed.2009.306.View ArticlePubMedGoogle Scholar
- Gigerenzer G, Gaissmaier W, Kurz-Milcke E, Schwartz LM, Woloshin S: Helping doctors and patients make sense of health statistics. Psycholog Sci Public Interest. 2007, 8: 53-96.Google Scholar
- Boutron I, Dutton S, Ravaud P, Altman DG: 'Spin' in reports of randomized controlled trials with nonstatistically significant primary outcomes. 6th International Congress on Peer Review and Biomedical Publication, Vancouver. (Accessed 30 March 2010), [http://www.ama-assn.org/public/peer/abstracts_2009.html#30]
- The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/1741-7015/8/24/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.