The analysis found a significant improvement in ROB domain measurements across dimensions since 2000. This is when the research community began to adopt detailed guidelines for published research.
"The research community can put insights from this study into action to increase public trust in food and nutrition research," said lead author Dr. Esther Myers, EF Myers Consulting, Inc., an internationally known author, lecturer, educator and researcher in dietetics and evidence analysis. "Based on our findings, I'd propose these strategies to improve future research: 1) enhance researcher training; 2) publish nutrition specific extension of reporting guidelines to address potential sources of bias; 3) continuously monitor for improvement; and 4) for enhanced transparency, commit to 100% disclosure of study funding source."
The research community has done particularly well, to date, in minimizing certain ROB domains:
- Attrition bias, or missing data, such as when participants drop out of a study
- Reporting bias, or ensuring study conclusions represent the data
- Selection bias, or how participants are chosen and assigned to groups
- Performance bias, or how study interventions are defined, measured and managed
- Detection bias, or how well researchers measure outcomes and account for other factors that might influence the results
- Publication year and study design were more consistent predictors of quality than study funding source. Industry-funded studies were not generally found to be lower in quality. Studies with "combined" funding sources - typically the work of public-private research partnerships - were higher in quality, by and large, than studies with single-source funding. It is widely recognized that there is a benefit to collaboration as experts bring different perspectives to the table.
This is the first scientific publication to statistically demonstrate that the guidelines for published research that have been in place since 2000 have been successful. Efforts to improve the quality of food and nutrition research are ongoing. ILSI North America has been working for the past 10 years alongside federal agencies and scientific professional societies to support continual improvement in scientific integrity. For more information, visit http://ilsina.org/our-work/scientific-integrity/.
1 Myers EF, Parrott JS, Splett P, Chung M, Handu D (2018) Using risk of bias domains to identify opportunities for improvement in food- and nutrition-related research: An evaluation of research type and design, year of publication, and source of funding. PLoS ONE 13(7): e0197425