Careers  |   Log In  |   Register  |   Welcome Center  |   Follow Us  Facebook  Twitter Google Plus

Drug and device trials vary in size, quality

NEW YORK (Reuters Health) – In an analysis of over 40,000 clinical trials registered in a government database, researchers found that many of those studies — looking at the effects of drugs, devices or behavioral interventions — were small and of inconsistent quality.

Those are the studies on which clinical guidelines are based, according to a report led by Dr. Robert Califf at the Duke Translational Medicine Institute in Durham, North Carolina.

“What’s at stake for the public is, you would want your doctor to know what he or she is doing as opposed to just guessing or having an opinion,” Dr. Califf told Reuters Health.

Using the database, Dr. Califf and his colleagues looked specifically at the records of 40,970 trials on medications, medical devices or lifestyle interventions for heart disease, cancer and mental health conditions registered between 2007 and 2010.

The majority of those trials – 62% — reported recruiting 100 or fewer patients. Two-thirds were conducted at a single research site.

Depending on the type of disease they covered, between 36% and 80% were randomized controlled trials.

About 7% of entries were missing information about the study’s primary outcome measure.

Of the trials that cited a funding source, 44% were being supported by a drug or device company, Dr. Califf’s team reported Tuesday in the Journal of the American Medical Association. Nine percent were funded by the National Institutes of Health, and almost half had another funding source, typically individual academic medical centers.

That shows an opportunity for more researchers working at a single site with their own funding to join forces on larger studies that produce more clinically-useful evidence, according to Dr. Califf.

“What I am concerned about is that we organize (trials) better,” he said.

Dr. Kay Dickersin from the Johns Hopkins Bloomberg School of Public Health in Baltimore said is an important way to keep track of the many studies that are started but never end up getting published, sometimes because the results weren’t what researchers were expecting.

She cited one case where there was plenty of unpublished data showing anti-arrhythmic drugs were potentially harmful for some patients — but because doctors didn’t have easy access to that information, they kept on prescribing them.

Dr. Dickersin, who wrote a commentary published with the study, told Reuters Health, “If the (published) evidence is only half the story and the positive half of the story, than in fact the evidence isn’t something solid, it’s not a solid foundation on which a decision is being made.”

Because of that, she added, the missing data in is a big concern, and shows that some researchers may not appreciate the scientific importance of the records.

What’s more, patients who participate in clinical trials should know if the study will ever see the light of day — and if it’s designed in a way that could inform future patient care, researchers said.

“Everyone who participates in a study should say, ‘Are you planning on publishing these results and, can I get a copy of what you find?’” Dr. Dickersin said.


JAMA 2012.