The FDA has traditionally required drug manufacturers to show that their products are more effective than a placebo, and that they don't do harm. But that is a low bar to jump. What patients and medical professionals really need to know is whether a new drug is better than the ones currently in use. Comparative effectiveness research is designed to answer this, and more specific questions. Does a new drug have fewer side effects, work in different care settings, work better for certain groups of patients, or in some other way prove its mettle?
This month Mark Olfson and Steven C. Marcus published a study in Health Affairs using the statistical tools of effectiveness research to take a new look at old drug studies, those reported in major medical journals from 1966 to 2010. A random sample of studies found that over time the effect size of new drugs has decreased. The newer the drug, the less effective it tends to be. We are getting diminishing returns for our health care buck.
The authors discussed several reasons this could be happening. New drugs are still coming to market, but there have been relatively few new drug classes. This is especially true of antibiotics. A second issue is that with the requirement in the U.S. since 2007 that all clinical trials be registered, there is no longer the opportunity to select only the strongest studies for publication. This would imply that the effectiveness of our medications was being statistically pumped up before the ClinicalTrials.gov registry was formed. A third possibility is that drug manufacturers have preferred to bring variations of already popular drugs to market rather than investing the time and money to develop new ones. In order to get the new version to pass FDA review they may resort to increasing the number of participants in the trial. Even a very small effect size can look statistically significant against a placebo with a large enough sample size. Sample sizes have indeed increased over the study period, making it a real possibility that drugs offering only a small tweak from standard treatments can pass review.
As the authors note, $100 billion is spent in the U.S. on biomedical research every year, and most of that is going into clinical trials. The diminishing rate of returns that this money has had in terms of clinical effectiveness makes it imperative that we shine light on this process. We need to guard against having clinical trials being used as marketing tools, and put the focus back on the reduction of human harm and suffering.
Read the Study: Decline in Placebo-Controlled Trial Results Suggests New Directions For Comparative Effectiveness Research
By Mark Olfson and Steven C. Marcus
As the authors note, $100 billion is spent in the U.S. on biomedical research every year, and most of that is going into clinical trials. The diminishing rate of returns that this money has had in terms of clinical effectiveness makes it imperative that we shine light on this process. We need to guard against having clinical trials being used as marketing tools, and put the focus back on the reduction of human harm and suffering.
Read the Study: Decline in Placebo-Controlled Trial Results Suggests New Directions For Comparative Effectiveness Research
By Mark Olfson and Steven C. Marcus