HEALTH NEWS

Study Title:

Outcome of Drug Trials Slanted by Big Pharma

Study Abstract

Background: Clinical trial registries are in widespread use to promote transparency around trials and their results.

Objective: To describe characteristics of drug trials listed in ClinicalTrials.gov and examine whether the funding source of these trials is associated with favorable published outcomes.

Design: An observational study of safety and efficacy trials for anticholesteremics, antidepressants, antipsychotics, proton-pump inhibitors, and vasodilators conducted between 2000 and 2006.

Setting: ClinicalTrials.gov, a Web-based registry of clinical trials launched in 1999.

Measurements: Publications resulting from the trials for the 5 drug categories of interest were identified, and data were abstracted on the trial record and publication, including timing of registration, elements of the study design, funding source, publication date, and study outcomes. Assessments were based on the primary funding categories of industry, government agencies, and nonprofit or nonfederal organizations.

Results: Among 546 drug trials, 346 (63%) were primarily funded by industry, 74 (14%) by government sources, and 126 (23%) by nonprofit or nonfederal organizations. Trials funded by industry were more likely to be phase 3 or 4 trials (88.7%; P < 0.001 across groups), to use an active comparator in controlled trials (36.8%; P = 0.010 across groups), to be multicenter (89.0%; P < 0.001 across groups), and to enroll more participants (median sample size, 306 participants; P < 0.001 across groups). Overall, 362 (66.3%) trials had published results. Industry-funded trials reported positive outcomes in 85.4% of publications, compared with 50.0% for government-funded trials and 71.9% for nonprofit or nonfederal organization–funded trials (P < 0.001). Trials funded by nonprofit or nonfederal sources with industry contributions were also more likely to report positive outcomes than those without industry funding (85.0% vs. 61.2%; P = 0.013). Rates of trial publication within 24 months of study completion ranged from 32.4% among industry-funded trials to 56.2% among nonprofit or nonfederal organization–funded trials without industry contributions (P = 0.005 across groups).

Limitations: The publication status of a trial could not always be confirmed, which could result in misclassification. Additional information on study protocols and comprehensive trial results were not available to further explore underlying factors for the association between funding source and outcome reporting.

Conclusion: In this sample of registered drug trials, those funded by industry were less likely to be published within 2 years of study completion and were more likely to report positive outcomes than were trials funded by other sources.

From press release:

When published results are systematically tracked for drug trials registered with ClinicalTrials.gov, those from industry-funded trials are the likeliest to be favorable to the drug in question, report researchers at Children's Hospital Boston.

Publishing in the August 3 issue of the Annals of Internal Medicine, the researchers call for more public disclosure about clinical drug trials at their outset to reduce the possibility of bias in the findings.

The research team, led by Florence Bourgeois, MD, MPH, of Children's Division of Emergency Medicine, and Kenneth Mandl, MD, MPH, Laboratory Director in the Children's Hospital Informatics Program, reviewed 546 drug trials conducted between 2000 and 2006 and listed with ClinicalTrials.gov, a comprehensive, web-based federal registry of clinical trials. The analysis focused on five classes of drugs: cholesterol-lowering drugs, antidepressants, antipsychotics, proton-pump inhibitors and vasodilators. The researchers scanned the medical literature for publications associated with each trial, checking four separate databases and contacting trial investigators directly if necessary.

Overall, allowing for a three-year lag time from the completion of the trial, two-thirds of the trials had published results. The industry-funded trials reported positive outcomes 85 percent of the time, as compared with 50 percent for government-funded trials and 72 percent for trials funded by nonprofits or non-federal organizations. In addition, among the nonprofit/nonfederal trials, those that had industry contributions (nearly half) were more likely than those without to report positive outcomes (85 vs. 61 percent). These differences were all statistically significant.

The researchers acknowledge that the pharmaceutical industry was probably more selective in which trials it funded, helping to account for their greater proportion of favorable outcomes. "Industry is very good at knowing what they want to study, and industry-sponsored studies are more efficient and well funded," says Bourgeois, the study's first author. "But despite these potential biases, this is a stunning result."

The industry-funded trials were in more advanced phases of study; 89 percent were Phase 3 or Phase 4, versus just 51 percent of government-funded trials and 65 percent of nonprofit/nonfederally-funded trials. However, even Phase 1 and 2 trials funded by industry reported the highest percentage of favorable outcomes.

In addition, industry-funded trials were the least likely to have published results within two years of study completion (32 percent) as compared with trials with no industry contributions (54 percent for government trials, and 56 percent for purely nonprofit/nonfederal trials).

As the researchers discuss in the paper, clinical trials can be manipulated in various ways to make the results appear more favorable. Publication bias -- a tendency to selectively publish only positive results of a trial, or delay publication of negative results -- is one factor that has received much attention, as in a well-publicized 2008 study of antidepressants in The New England Journal of Medicine.

"While we cannot specifically point to which factors contribute to the association between funding source and positive result reporting, our findings speak to the need for more disclosure of all elements of a study," says Bourgeois. "Publication bias is likely a contributing factor, but there may be many more, including biases in study design, patient selection, data analysis and results reporting."

The use of registries like ClinicalTrials.gov, launched in 1999, was hoped to reduce publication bias by creating a record for all clinical trials. In addition, in 2005, the International Committee of Medical Journal Editors began requiring that a trial be registered before enrolling patients in order to be considered for publication, thus creating a record of the planned study outcomes before the study's initiation. In 2007, the FDA expanded the scope of ClinicalTrials.gov, requiring the sponsors of all drug, biologic and device trials to register their studies upon launch (phase I trials excepted).

If trial protocols are made public in advance, a trial sponsor is less able to manipulate or selectively publish the findings, the researchers argue. "Our main call is for transparency, to enable better understanding of the impact of funding source on the study outcomes, and for all study results -- good or bad -- to be made available," says Mandl, the study's senior investigator, also an Associate Professor at Harvard Medical School.

Study Information

Florence T. Bourgeois, Srinivas Murthy, and Kenneth D. Mandl
Outcome Reporting Among Drug Trials Registered in ClinicalTrials.gov
Annals of Internal Medicine
2010 August
Children's Hospital Boston, Harvard Medical School, and Children's Hospital Informatics Program, Harvard-MIT Division of Health Sciences and Technology, Boston, Massachusetts.