LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

The fragility of trial results involves more than statistical significance alone.

Photo by nappystudio from unsplash

OBJECTIVES The fragility of clinical trial findings has been previously defined as the number of changes in outcomes that are required to change their statistical significance. We show that reliance… Click to show full abstract

OBJECTIVES The fragility of clinical trial findings has been previously defined as the number of changes in outcomes that are required to change their statistical significance. We show that reliance on statistical significance alone provides only a limited and potentially misleading perspective, and an enhanced approach is developed. METHODS Clinical importance of trial results and their quantitative stability are incorporated into an enhanced framework to assess fragility. RESULTS Examples show that the small data changes required to affect statistical significance may actually be unlikely to occur. Recognising this limitation, and because statistical significance conveys no information about the treatment effect size, our approach additionally takes into account the clinical importance of the results, and their quantitative stability. The interpretation of studies with various combinations of these features is described. CONCLUSION The concept of fragility should include clinical importance of trial findings and their quantitative stability, as well as statistical significance. Study results should be declared as stable only if they are statistically significant and quantitatively stable, but they can be either clinically important or unimportant; otherwise the findings should be declared as unstable, or fragile. (185 words).

Keywords: statistical significance; clinical importance; trial results; significance alone; significance

Journal Title: Journal of clinical epidemiology
Year Published: 2020

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.