- Open Access
A systematic search and qualitative review of reporting bias of lifestyle interventions in randomized controlled trials of diabetes prevention and management
Nutrition Journal volume 17, Article number: 83 (2018)
Scholars have documented presumptions regarding the relationships between diet, exercise, weight, and type 2 diabetes. However, it is unclear to what extent researchers contribute to these presumptions, and how often these relationships are thoroughly delineated within the context of randomized controlled trials (RCTs). Thus, the aim was to conduct a systematic search and qualitative, thematic analysis of RCTs focusing on lifestyle interventions for diabetes prevention or management, to examine how researchers discuss body weight in 1) the rationale and design of their RCTs; and 2) their presentation and interpretation of their findings.
We completed an electronic search for records published between 2007 and November 2016. Selection criteria included: RCTs with a follow-up period of ≥12 months; adult participants with type 2 diabetes/pre-diabetes; lifestyle interventions classified as dietary, exercise, and/or behavioural; primary outcomes of incident diabetes and complications, mortality, cardiovascular disease, and quality of life; and secondary outcomes of glycemic control and blood pressure. Nineteen articles were identified for inclusion and subject to thematic content analysis.
Obesity and weight loss figured prominently in the rationale and outcomes of the majority of the articles, despite intentional exclusion of “weight loss” and “obesity” as search terms. There was ambiguity over whether weight loss was classified as inclusive to the intervention, an outcome, or a measure of adherence. Results revealed that authors frequently engaged in “spin reporting” by pooling data from intervention and control groups to test the relationship between weight lost and outcomes and in their presentation of results.
Researchers need to be aware of their biases and assumptions regarding body weight in designing, analyzing, and interpreting lifestyle interventions for diabetes prevention and management.
The global prevalence of type 2 diabetes is growing, with 642 million adults estimated to have diabetes in 2014 . Lifestyle changes, specifically, diet and activity, are understood to be important in primary and secondary prevention of diabetes complications. Lifestyle recommendations are based mostly on observational epidemiological studies in which causality cannot be inferred. Randomized controlled trials (RCTs) are viewed as one of the highest forms of evidence , and intervention research following this method is thought to potentially alleviate the methodological concerns of observational data. The Diabetes Prevention Program (DPP), one of the earliest RCTs of lifestyle for diabetes prevention, helped to establish that lifestyle changes could delay the onset of type 2 diabetes by 4 years in participants with overweight or obesity and impaired glucose tolerance . Weight loss was determined to be the most important contributor to the lifestyle intervention effect . Subsequently, diabetes prevention programs have been translated into multiple settings, often with a focus on participants with overweight and obesity.
Obesity is a risk factor for type 2 diabetes , though type 2 diabetes does affect individuals of all sizes. Despite the potential for individuals of any size to develop diabetes, diabetes is often conflated with obesity; both conditions are frequently depicted as caused by similar dietary and exercise-related choices . This conflation has important implications for how diabetes is presented and treated in research, practice, and policy. Scholars have begun to call attention to the myriad of myths and presumptions, the imprecision of measures, lowered validity claims, and the non-specified etiological mechanisms in obesity research [7,8,9]. Obesity research may be particularly susceptible to these elisions because obesity is also a stigmatized and morally-laden condition. Obesity is often presented in reductionist terms as a matter of personal responsibility caused by a simplified energy imbalance model [10, 11].
While some view more RCTs as one way of rectifying issues concerning validity, objectivity, and precision , even well-designed, carefully interpreted, and valuable RCTs do not exist in a vacuum; many limitations of RCTs have been reported in the literature [12,13,14,15,16]. Systematic reviews and corresponding quantitative meta-analysis of RCTs, the apex of the evidence hierarchy, are designed to minimize and also detect bias, such as selection bias, performance bias, detection bias, attrition bias, and reporting bias . Reporting bias can be further categorized as publication bias, time lag bias, multiple publication bias, location bias, citation bias, language bias, and outcome reporting bias . Unfortunately, quantitative methods to detect various biases are not well-developed. While the Cochrane Handbook has described areas for qualitative analysis in systematic reviews, this is limited to the systematic review of qualitative research in the same content area of the corresponding meta-analysis of RCTs. Qualitative methods may be useful for systematically analysing bias, particularly reporting bias that is potentially influenced by the social stigmatization of obesity and reductionist approaches to obesity research.
What we detected in the present analysis has previously been labelled “spin reporting” by Boutron and colleagues . Spin reporting is defined as “reporting that can distort the interpretation of results and mislead readers”, usually to present the experimental treatment as effective. This concept encompasses a broad range of reporting issues, including, but not limited to, focussing on statistically significant results, interpreting non-significant findings as demonstrating comparable effectiveness, or asserting beneficial treatment effects despite non-significant findings . Spin reporting may in turn contribute to the imprecision and assumptions that underlay “diabesity research” more generally. Thus, the aim was to conduct a systematic search for RCTs focusing on lifestyle interventions for diabetes prevention or management, while purposefully excluding body weight-related terms in our search strategy, to uncover the extent to which measures of body weight are conflated with diabetes. Using a qualitative, thematic analysis, we then sought to examine how researchers discussed body weight in 1) the rationale and design of their RCTs; and 2) their presentation and interpretation of their findings.
Design and search strategy
We conducted a systematic search for peer reviewed journal articles using the following electronic databases: CINAHL, EMBASE, PsychInfo, PubMed, and Web of Science. We searched for articles published in English between January, 2007 and November, 2016. These dates were selected to represent current research in the area. Study selection keywords included those related to type II diabetes mellitus (such as “diabetes mellitus, type 2”) as well as keywords related to lifestyle interventions, used in the prevention or management of type 2 diabetes (including, but not limited to terms such as “exercise”, “nutrition”, “diet therapy” etc.). Search term selection was modelled after a Cochrane Review , though the terms, “obesity”, “body weight”, “body mass index”, and “weight loss” were purposefully not included in the search. A complete list of search terms can be found in Appendix 1. We also completed a hand search following the systematic search. This systematic review is not registered.
Selection criteria included: RCTs with a follow-up period of at least 12 months. Participants were persons ≥18 years of age with type 2 diabetes or pre-diabetes, defined using either impaired fasting glucose or impaired glucose tolerance regardless of criteria. Lifestyle interventions were classified as dietary, exercise, and/or behavioural, and did not include herbal remedies or nutraceuticals (such as n-3 fatty acid supplements) or interventions of single dietary aspects (i.e. GI index, fibre, meal replacements, etc.). Interventions that were exclusively focused on changing behaviours of health professionals or surgical interventions were also excluded from this analysis. Comparison group(s) could include either usual care or a similar intervention at differing intensity (ie. physical activity or diet program alone). Primary study outcomes were incident diabetes, mortality, cardiovascular disease, diabetes complications, and quality of life. Secondary outcomes included glycemic control (either fasting glucose or HbA1c), hypertension, and/or blood pressure. To be included, articles had to report on at least one primary or secondary outcome, though these outcomes were not the subject of our analysis. All eligible articles were subject to thematic content analysis to explore the research questions and identified through clinical trial registries to enhance our analysis. Specifically, we collected registered participant inclusion criteria and outcomes (primary and secondary) related to body weight and compared to what was published in our included articles.
All articles were uploaded into NVivo 10 (QSR International) for analysis and analyzed using the framework method as described by Gale and colleagues  as well as holistic coding, which applies a single code to each large unit of data to capture overall content as well as possible categories . All references to “obesity” and “weight” were identified, tabulated, and assigned an in vivo code, a form of coding that labels units of data according to the literal language present in the data source . In vivo codes were subsequently subject to second-cycle concept coding in which the literal codes were assigned to categories based on their underlying meaning . Lastly, patterns among the codes were identified inductively among conceptual categories. Similar, inter-related categories were then collapsed into themes. Rigor was enhanced through ongoing peer debriefing, investigator triangulation, and literature review . Additional themes and conceptual categories, other than what is presented in the present article are forthcoming .
The search retrieved 11,183 references. NR, AM and JB screened all titles, excluding duplicate articles (n = 2542) and those published outside of the selection window (n = 2492). Following this, abstracts deemed appropriate were evaluated by AM and NR, of which 32 full articles were retrieved for further, more detailed evaluation. The final selection excluded articles using different study designs, those with a follow-up period < 12 months, as well as those with ineligible outcomes, as described in our methods (n = 13). Additionally, one study was excluded due to lack of usable data because it was a thesis; it was considered too unwieldy to analyze qualitatively (Fig. 1). In total, 19 papers fulfilled the search criteria and were included in our qualitative analysis (Appendix 2). Of the 19 studies, half included data collected in the USA, with the remaining studies gathering data from Japan, Finland, Australia, Denmark, and Sweden. Additionally, five studies reported results from the Action for Health in Diabetes (Look AHEAD) trial (Alonso et al., 2015; Jakicic et al., 2013; Look AHEAD, 2010; Look AHEAD, 2013; Zhang et al., 2016), which was an RCT originally designed to determine whether intentional weight loss and increased physical activity would reduce cardiovascular morbidity and mortality in overweight individuals with type 2 diabetes undertaken in 16 American centres.
Studies included reported on various primary and secondary study outcomes, including incident diabetes (n = 6), mortality (n = 2), cardiovascular disease (n = 4), diabetes complications (n = 2), quality of life (n = 2), glycemic control (n = 18), and hypertension and/or blood pressure (n = 12). Despite intentional exclusion of the terms “weight loss” and “obesity” in the initial search, all studies observed change in body weight as an outcome to assess effectiveness of interventions. Fourteen of the articles had their trials registered through clinicaltrials.gov (including multiple articles from one trial). An additional two trials were found to be registered at UMIN-CTR Clinical Trial. Of the 16 articles with registered trials, nine did not register weight loss, obesity, body weight, or BMI as a primary or secondary outcome. The overarching theme that emerged in our qualitative analysis was spin reporting (Table 1).
Spin reporting was consistently observed in all articles to varying degrees and in many forms. A common form of spin deployed in the reviewed articles was the pooling of intervention and control group data to test for associations of weight loss with other outcomes. “By pooling data from intervention and control groups for the analysis of weight loss and T2D incidence, we sought to evaluate the utility of sustained weight loss as an intermediate health outcome” (Penn et al. 2013; 5). Pooled data was also presented in various figures and tables, particularly with respect to weight loss. The graphical and tabular depiction of pooled weight loss data helped to cement the importance placed on weight loss in the publications - despite lifestyle change being the intervention of all included RCTs. This approach effectively eliminates the strength of an RCT design – and transforms interventional data into observational data.
Within group differences
Authors also reported within group differences rather than, or prior to, between-group differences - despite this being counter to RCT design; for example, Christian et al. (2008;144), states, “Although 59% of the intervention patients experienced reductions in HbA1c level, this was not significantly different”. Non-significant primary outcomes were often minimized by emphasizing the direction/magnitude of change in the lifestyle group (despite non-significance) and/or prioritizing secondary positive outcomes. For instance, Juul and colleagues (2016; 118) write, “A brief theory-based health promotion intervention provided in the community indicated positive effect on weight, waist circumference and systolic blood pressure over one year among Danish adults at high risk of type 2 diabetes. However, there were no statistically significant differences in the primary outcomes of the DPS behavioural goals at one year”. Weight loss was also commonly reported first in the series of results, giving the impression of more importance of these results, compared to even primary outcomes.
Weight as multiple measures
Body weight was not consistently described as one type of measure throughout the studies. Body weight measures [Body Mass Index (BMI) or weight] were discussed as inclusion criteria, a measure of adherence to lifestyle intervention, an intermediate outcome, and/or as a study outcome. These inconsistencies are in alignment with the discrepancies described above concerning registered trial outcomes.
BMI was included as inclusion criteria in all but five studies, with varying BMI cut-off points between studies but generally above 24 kg/m2 (i.e. overweight). Body weight was presented as a key characteristic in identifying individuals at-risk of developing diabetes and complications, even when diabetes, fasting glucose, or oral glucose tolerance testing were also used as inclusion criteria.
Authors justified pooling intervention and control groups and analyzing these data to test for relationships between weight loss and outcomes by arguing that doing so revealed the true intervention effect. In this way, weight loss was insinuated to signal dietary or exercise changes in line with the intended intervention, regardless of whether weight loss occurred in the intervention or control group. This notion was further reiterated when dietary data were deemed unreliable by some authors. In this context, weight loss was presented as an objective measure of intervention adherence. “Weight loss is attractive for monitoring compliance with interventions in routinely provided services, because it can be easily and objectively measured” (Penn et al., 2013; 8).
Weight and conclusions
Weight loss was also presented as certain to lead to diabetes prevention, irrespective of whether the studies included diabetes incidence as an outcome (Ackerman et al., 2015; Marrero et al., 2015; Nilsen et al., 2011). Ackerman et al. (2015;2333) pronounce that “modest weight losses translate into fewer cardiovascular events, lower health care consumption, and better quality of life for most community-dwelling adults with prediabetes”. Authors discussed and concluded with varying degrees of certainty that significant weight losses observed in lifestyle intervention groups demonstrates the intervention’s capacity to prevent diabetes. “These data suggest that Weight Watchers, a widely available, empirically validated weight-management program, could offer a potential tool to significantly expand access to diabetes prevention programs in community settings and produce weight-loss levels that translate into considerable reductions in diabetes risk” (Marrero et al. 2016; 955). The misalignment of reported results with conclusions was a common type of spin, particularly with respect to the leap from weight loss to diabetes prevention.
In summary, despite the exclusion of weight-related search terms, obesity and weight loss figured prominently in the rationale, results, and interpretation of the articles. It was unclear whether weight loss was the intervention itself, a measure of adherence, or a study outcome. How studies were reported in trial registries only contributed to this confusion. Spin reporting was manifested in the focus on weight loss placed throughout the articles (contrary to design and registry outcomes) including in reporting of results; how the pooling of results produced the observational analysis of weight loss and various outcomes; and the reporting of within group differences prior to, or instead of, between group differences.
The incongruence of registered versus published outcomes is similar to RCTs in other fields [13,14,15]. Researchers, reviewers, and editors must take greater care to ensure alignment between registration and publication. Registration of RCTs was undertaken primarily to minimize publication bias, and selective reporting of outcomes, among other reasons. However, without appropriate verification, the purpose of registration may not be met. This misalignment may be partially explained by researchers’ lack of agreement on whether weight loss is in fact an (intermediate) outcome, a measure of intervention adherence, or the intervention itself. Without this explicit distinction, it is difficult to interpret the data and more importantly, the implications of lifestyle interventions for diabetes prevention.
Spin reporting, including all types reported here, have also been previously described among RCTs in other fields [16, 23,24,25]. Thus this finding is not specific to obesity or diabetes research but perhaps partially characteristic of RCT reporting. Spin reporting, in other fields, has also been associated with industry funding . Though we did not investigate any role for industry funding in our analysis, it should be mentioned that many industries benefit from the personal responsibility framing of obesity and, by extension, type 2 diabetes.
RCTs require substantial investment of time and resources, particularly when disease incidence is the primary outcome and length of follow-up is long. This context, combined with pressure to publish and potential hardship related to publishing non-significant findings, may contribute to spin reporting in general. Notably, a recent meta-analysis of RCTs, using similar inclusion criteria as the present study, indicated significant publication bias in this area such that approximately 9 studies with null effects were estimated to be missing . Unique to the present study and our related critical social science analysis  is the qualitative investigation of language and the potential role that social, and often moralistic, presentations of body weight may play in spin reporting and how results are presented, unlike many other health-related conditions. In turn, spin reporting in RCTs has been demonstrated to influence readers’ interpretation of study results , which may be especially problematic given the prominence of the “gold standard” RCT design. Boutron and Ravaud  have previously discussed potential strategies for mitigating spin through changes to the academic reward system.
Five studies did not include BMI as inclusion criteria. This, combined with the emphasis on weight loss in most studies, is problematic as it leaves little room in the “gold standard” research base for producing valuable knowledge on weight changes as a symptom of diabetes, and individuals with diabetes, impaired glucose tolerance, or impaired fasting glucose who have a “healthy” BMI. Ethnic minorities represent a disproportionate number of these cases . Some studies attempted to account for this by including lowered BMI cut-points for inclusion criteria of participants of Asian descent (ex. Marrero et al. 2016). Several authors acknowledged the important role ethnicity plays in the relationship between body weight and diabetes, and the limited research in this area. Notably, three of the studies without BMI inclusion criteria included exclusively Japanese participants. The overrepresentation of weight loss trials for diabetes prevention was framed as important rationale by Sone et al. (2010) for their trial with Japanese participants without a specific focus on weight loss or inclusion of only overweight or obese participants. Relevantly, the trial by Sakane and colleagues (2011), which included Japanese participants of any BMI found that lifestyle intervention significantly reduced diabetes incidence only among the sample with BMI > 22.5. Taken together, the existing focus of lifestyle interventions aimed at weight loss for type 2 diabetes among overweight/obese participants may represent a form of inequity towards ethnic minorities by way of analytic omission. Importantly, India and China have the highest number of people living with diabetes among all countries globally .
Intermediate or surrogate outcomes are much more common among RCTs as compared to observational studies due to the long follow-up period required in RCTs to obtain sufficient statistical power for analysis of clinical end points. Regardless of these limitations, surrogate outcomes must be validated. In this way, weight loss must have been shown to predict clinically important outcomes, such as diabetes incidence . However, the relationship between weight loss and diabetes incidence remains disputable; despite early confirmatory results in the Diabetes Prevention Program, diabetes incidence was not significantly different between lifestyle and control groups at 10-year follow-up, regardless of greater initial weight loss among the lifestyle group . Furthermore, several observational studies support an inverse relationship between BMI and mortality among individuals with diabetes [33, 34], and weight loss among those with diabetes is not necessarily beneficial [35, 36]. Importantly, weight loss is rarely sustainable due to involuntary, homeostatic pressures [37, 38]. This large and growing body of research disputes the validity of weight loss as necessarily a surrogate measure for diabetes prevention.
The practical implications of the over-reliance on weight loss as a surrogate outcome for diabetes prevention needs to be considered as well, particularly given that its validity is questionable. Firstly, the role of weight loss in diabetes prevention may have particular incongruencies with patient-oriented care; and secondly, weight bias in health care may be an added barrier to diabetes management  and cardiovascular care . Velentgas and colleagues  report that patients often are less concerned with intermediate pathways without clear links to clinical impact. This may be further magnified by how researchers make assumptions concerning participants’ adherence/compliance based on weight loss measures , which eliminates a) the truly democratic shared decision model espoused in patient-centred practice [42, 43]; and b) may contribute to patients fearing clinicians’ assumptions regarding lifestyles and ultimately, treatment avoidance .
Researchers must more carefully assess how they discuss participants in terms of compliance, particularly with respect to highly stigmatized conditions such as obesity and diabetes. Researchers must reflect on their own views and biases in data interpretation and how this may translate into clinically important assessments of symptoms, functioning, and quality of life . Ultimately, patients and practitioners want trusting, mutually-respectful relationships in which they feel heard, and physicians and patients agree that empathy and respect are essential when addressing weight in health care settings . Essential to this patient-centred agenda is an evidence-base that does not over-emphasize weight, blame patients for intervention failures, simplify weight issues to a matter of adherence, or reinforce a moralistic imperative (good vs. bad patients) concerning patient adherence .
This study is subject to limitations. First, articles published in a language other than English were excluded, thus constituting our own reporting bias. Second, our thematic analysis was limited to the ways in which body weight may have introduced bias in the development and reporting of RCTs; no other forms of bias were examined. Third, our search protocol is not registered.
This thematic analysis of RCTs to prevent diabetes found evidence to reinforce critiques raised by others that obesity research has come to be characterized by the reiteration of a series of infrequently challenged myths, presumptions, and suppositions [8, 9]. Our study suggests that even in valuable, carefully designed RCTs, there is an entrenchment of certain biases regarding obesity, weight loss, and diabetes prevention. These biases influence the analyses, interpretation and depiction of results concerning weight, diet, and exercise in diabetes interventions, which in turn may reinforce stereotypes that an individuals’ body weight is a result of their diet and exercise, and lack of weight loss indicates lack of compliance with an intervention. Ultimately, facile interpretations carry political implications in terms of research funding,8 and this affects the lives and health of the general public, those at risk for diabetes, and those already living with diabetes. While registration of full trial protocols with a priori information on secondary analyses is necessary to begin to address reporting bias, it would not be sufficient. A patient-oriented approach to research and clinical practice that is based on respect and empathy is an important step in shaping future research in diabetes prevention and management.
Body mass index
Randomized controlled trial
International Diabetes Federation. Diabetes Atlas. seventh ed; 2015. www.diabetesatlas.org. Accessed 30 May 2017
Solomon M. Making medical knowledge. Oxford: Oxford University Press; 2015.
Diabetes Prevention Program Research Group. 10 –year follow-up of diabetes incidence and weight loss in the diabetes prevention program outcomes study. Lancet. 2009;374:1677–86.
Hamman RF, Wing RR, Edelstein SL, Lachin JM, Bray DA, Delahanty L, Hoskin M, Kriska AM, Mayer-Davis EJ, Pi-Sunyer X, Regensteiner J, Venditti B, Wylie-Rosett J. Effect of weight loss with lifestyle intervention on risk of diabetes. Diabetes Care. 2006;29:2102–7.
Mokdad AH, Ford ES, Bowman BA, Dietz WH, Vinicor F, Bales VS, Marks JS. Prevalence of obesity, diabetes, and obesity-related health risk factors, 2001. JAMA. 2003;289(1):76–9.
McNaughton D. In: McCullough MB, Hardin JA, editors. “Diabesity” and the stigmatizing of lifestyle in Australia. New York: Berhahn Books; 2013. p. 71–86.
Aphramor L. Validity of claims made in weight management research: A narrative review of dietetic articles. Nutr J. 2010;9(1)
Hebert JR, Allison DB, Archer E, Lavie CJ, Blair SN. Scientific decision making, policy decisions, and the obesity pandemic. Mayo Clin Proc. 2013;88(6):593–604.
Casazza K, Fontaine KR, Astrup A, Birch LL, Brown AW, Bohan Brown MM, Durant N, Dutton G, Foster EM, Heymsfield SB, McIver K. Myths, presumptions, and facts about obesity. N Engl J Med. 2013;368(5):446–54.
Gard M, Wright J. The obesity epidemic: science, morality and ideology. Abingdon, Oxon: Routledge; 2005.
Puhl RM, Heuer CA. Obesity stigma: important considerations for public health. Am J Public Health. 2010;100(6):1019–28.
Golfam M, Beall R, Brehaut J, Saeed S, Relton C, Ashbury FD. Comparing alternative design options for chronic disease prevention interventions. Eur J Clin Investig. 2015;45(1):87–99.
Chan AW, Kreza-Jeric K, Schmid I, Altman DG. Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research. CMAJ. 2004;171(1):735–40.
Jones CW, Keil LG, Hollan WC, Caughey MC, Platts-Mills TF. Comparison of registered and published outcomes in randomized controlled trials: a systematic review. BMC Med. 2015; https://doi.org/10.1186/s12916-015-0520-3.
Mathieu S, Boutron I, Moher D, Altman DG, Ravaud P. Comparison of registered and published primary outcomes in randomized controlled trials. JAMA. 2009;302(9):977–84.
Boutron I, Dutton S, Ravaud P, Altman DG. Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. JAMA. 2010;303(20):2058–64.
Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available from http://handbook.cochrane.org. Accessed 31 July 2018.
Norris SL, Zhang X, Avenell A, Gregg E, Schmid CH, Lau J. Long-term non-pharmacological weight loss interventions for adults with prediabetes. Cochrane Database Syst Rev. 2005:2. https://doi.org/10.1002/14651858.CD005270.
Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13(1):117.
Saldaña J. Goodall’s verbal exchange coding an overview and example. Qual Inq. 2016;22(1):36–9.
Creswell JW. Research design: qualitative, quantitative, and mixed methods approaches: Sage Publications; 2013.
Bombak AE, Riediger ND, Bensley J, Ankomah S, Mudryj A. A systematic search and critical thematic, narrative review of lifestyle interventions for the prevention and management of diabetes. Crit Public Health. under review
Arunachalam L, Hunter IA, Kileen S. Reporting of randomized controlled trials with statistically nonsignificant primary outcomes published in high-impact surgical journals. Ann Surg. 2017;265(6):1141–5.
Beijers L, Jeronimus BF, Turner EH, De Jonge P, Roest A. Spin in RCTs of anxiety medication with positive primary outcome: a comparison of concerns expressed by the US FDA and in the published literature. BMJ Open. 2017;7(3):012886.
Turrentine M. It’s all how you “spin” it. Interpretive bias in research findings in the obstetrics and gynecology literature. Obstet Gynecol. 2017;129(2):239–42.
Probst P, Knebel P, Grummich K, Tenckhoff S, Ulrich A, Büchler MW, Diener MK. Industry bias in randomized controlled trials in general and abdominal surgery: an empirical study. Ann Surg. 2016;264(1):87–92.
Haw JS, Galaviz KI, Straus AN, Kowalski AJ, Magee MJ, Weber MB, Wei J, Narayan V, Ali MK. Long-term sustainability of diabetes prevention approaches: a systematic review and meta-analysis of randomized clinical trials. JAMA Intern Med. 2017;177(12):1808–17.
Boutron I, Altman DG, Hopewell S, Vera-Badillo F, Tannock I, Ravaud P. Impact of spin in the abstracts of articles reporting results of randomized controlled trials in the field of cancer: the SPIIN randomized controlled trial. J Clin Oncol. 2014;32:4120–6.
Boutron I, Ravaud P. Misrepresentation and distortion of research in biomedical literature. Proc Natl Acad Sci U S A. 2018;115(11):2613–9.
Paul SK, Owusu Adjah ES, Samanta M, Patel K, Bellary S, Hanif W, Khunti K. Comparison of body mass index at diagnosis of diabetes in a multi-ethnic population: a case-control study with matched non-diabetic controls. Diabetes Obes Metab. 2017;19(7):1014–23.
Wild S, Roglic G, Green A, Sicree R, King H. Global prevalence of diabetes: estimates for the year 2000 and projections for 2030. Diabetes Care. 2004;27(5):1047–53.
D’Agostino RB. Debate: the slippery slop of surrogate outcomes. Curr Control Trials Cardiovasc Med. 2000;1(2):76–8.
Carnethon MR, De Chavez PJD, Biggs ML, Lewis CE, Pankow JS, Bertoni AG, Golden SH, Liu K, Mukamal KJ, Campbell-Jenkins B, Dyer AR. Association of weight status with mortality in adults with incident diabetes. JAMA. 2012;308(6):581–90.
Kalantar-Zadeh K, Rhee CM, Amin AN. To legitimize the contentious obesity paradox. Mayo Clin Proc. 2014;89:1033–5.
Kocarnik BM, Moore KP, Smith NL, Boyko EJ. Weight change after initiation of oral hypoglycemic monotherapy for diabetes predicts 5-year mortality: an observational study. Diabetes Res Clin Pract. 2017;123:181–91.
Gregg EW, Gerzoff RB, Thompson TJ, Williamson DF. Trying to lose weight, losing weight, and 9-year mortality in overweight U.S. adults with diabetes. Diabetes Care. 2004;27:657–62.
Mann T, Tomiyama AJ, Ward A. Promoting public health in the context of the “obesity epidemic”: false starts and promising new directions. Perspect Psychol Sci. 2015;10(6):706–10.
MacLean PS, Bergouignan A, Cornier MA, Jackman MR. Biology’s response to dieting: the impetus for weight regain. Am J Phys Regul Integr Comp Phys. 2011;301(3):R581–600.
Teixeira ME, Budd GM. Obesity stigma: a newly recognized barrier to comprehensive and effective type 2 diabetes management. J Am Acad Nurse Pract. 2010;22(10):527–33.
Merz CNB, Anderson H, Sprague E, Burns A, Keida M, Walsh MN, Greenberger P, Campbell S, Pollin I, McCullough C, Brown N, Jenkins M, Redberg R, Johnson P, Robinson B. Knowledge, attitudes, and beliefs regarding cardiovascular disease in women. J Am Coll Cardiol. 2017;70(2):123–32.
Velentgas P, Dreyer NA, Wu AW. Chapter 6: outcome definition and measurement. In: Eds Velentgas P, Dreyer NA, Nourjah P, et al., editors. Developing a protocol for observational comparative effectiveness research: a User’s guide. Agency for Healthcare Research and Quality: Rockville; 2013.
Frosch DL, Kaplan RM. Shared decision making in clinical medicine: past research and future directions. Am J Prev Med. 1999;17(4):285–94.
Goldbach PD. Power to the patient. Shared decision making improves care and reduces costs. Mod Healthc. 2013;43(14):21.
Rutten GEHM, Alzaid A. Person-centred type 2 diabetes care: time for a paradigm shift. Lancet Diabetes Endocrinol. 2018;6(4):264–6.
Heintze C, Sonntag U, Brinck A, Huppertz M, Niewöhner J, Wiesner J, Braun V. A qualitative study on patients' and physicians' visions for the future management of overweight or obesity. Fam Pract. 2012;29(1):103–9.
Renedo A, Marston C. Developing patient-centred care: An ethnographic study of patient perceptions and influence on quality improvement. BMC Health Serv Res. 2015;15(1)
Support during the search process by Ms. Robin Sabo is appreciated. We would also like to thank Dr. Shayne Taback for his insights regarding randomized controlled trials.
Availability of data and material
All articles analysed for this study are listed in this published article.
This research was partially funded through research start-up research funds to AB (Central Michigan University) and NR (University of Manitoba).
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Search terms for study selection
(“Diabetes Mellitus Type 2”[Mesh] OR maturity-onset diabetes of the young[Title/Abstract] OR MODY[Title/Abstract] OR dm2[Title/Abstract] OR niddm[Title/Abstract] OR iidm[Title/Abstract] OR non insulin depend*[Title/Abstract] OR noninsulin depend*[Title/Abstract] OR type 2 diab*[Title/Abstract] OR type II diab*[Title/Abstract] OR ketosis resistant diabetes[Title/Abstract] OR adult onset diabet*[Title/Abstract] OR late onset diabet*[Title/Abstract] OR maturity onset diabet*[Title/Abstract] OR slow onset diabet*[Title/Abstract] OR stable onset diabet*[Title/Abstract] OR stability onset diabet*[Title/Abstract] OR plurimetabolic syndrome[Title/Abstract]) AND (“Exercise”[Mesh] OR “Physical Education and Training”[Mesh] OR “Physical Fitness”[Mesh] OR “Life Style”[Mesh] OR “Health Education”[Mesh] OR “Health Behavior”[Mesh] OR “Health Promotion”[Mesh] OR “Sports”[Mesh] OR “Physical Exertion”[Mesh] OR “Exercise Therapy”[Mesh] OR “Nutrition Therapy”[Mesh] OR “Diet Therapy”[Mesh] OR “Feeding Behavior”[Mesh] OR “Running”[Mesh] OR “DietDiabetic”[Mesh] OR “Jogging”[Mesh] OR “Swimming”[Mesh] OR “Walking”[Mesh] OR “Bicycling”[Mesh] OR exercise[Title/Abstract] OR exercising[Title/Abstract] OR exertion*[Title/Abstract] OR sport[Title/Abstract] OR sports[Title/Abstract] OR walking[Title/Abstract] OR jogging[Title/Abstract] OR swimming[Title/Abstract] OR strength train*[Title/Abstract] OR resistance train*[Title/Abstract] OR aerobic train*[Title/Abstract] OR physical education*[Title/Abstract] OR physical fitness[Title/Abstract] OR nutrition[Title/Abstract] OR nutritional [Title/Abstract] OR life style[Title/Abstract] OR lifestyle[Title/Abstract] OR health behav*[Title/Abstract] OR health educ*[Title/Abstract] OR health promot*[Title/Abstract] OR physical activit*[Title/Abstract] OR bicycling[Title/Abstract] OR weight lift*[Title/Abstract] OR running[Title/Abstract] OR gymnastic*[Title/Abstract] OR dance[Title/Abstract] OR dancing[Title/Abstract]OR diet[Title/Abstract]) NOT (“Dermatomyositis”[Mesh] OR “Myotonic Dystrophy”[Mesh] OR “Diabetes Insipidus”[Mesh] OR “DiabetesGestational”[Mesh]) AND (“humans”[MeSH Terms] AND English[lang] AND “adult”[MeSH Terms]) AND (Clinical Trial[ptyp] OR Randomized Controlled Trial[ptyp] OR randomized[Title/Abstract] OR placebo[Title/Abstract] OR randomly[Title/Abstract] OR trial[Title])
About this article
Cite this article
Riediger, N.D., Bombak, A.E., Mudryj, A. et al. A systematic search and qualitative review of reporting bias of lifestyle interventions in randomized controlled trials of diabetes prevention and management. Nutr J 17, 83 (2018). https://doi.org/10.1186/s12937-018-0390-6
- Randomized controlled trials
- Spin reporting
- Reporting bias
- Participant adherence
- Patient-oriented research