“These are the studies that showed no benefit of the antidepressant over the placebo. What they did is they took the more successful studies, they published most of them. They took their unsuccessful studies and they didn’t publish them.” – Irving Kirsch
“This is a multibillion dollar industry. I doubt that they are spending $10 million per trial to come up with a poor methodology. What characterizes the unpublished is that they’re negative. Now I don’t think it’s that their method is somehow wrong; it’s that their outcome is not suitable from the company’s point of view.” —Dr. Tim Kendall
Pharmalot
By Ed Silverman
February 21, 2012
We all know about the placebo effect. But a Harvard Medical School professor has applied the same theory to antidepressants and his findings are likely to rile drugmakers. Why? He filed Freedom of Information Act requests to obtain unpublished clinical trial data and found that, when combining results with published data, the various antidepressants were no better than dummy pills.
“These are the studies that show no benefit of the antidepressant over the placebo. What they did was they took more successful studies – they published most of them – and they took their unsuccessful studies, and they didn’t publish that…. If they were mildly or moderately depressed, you don’t see a difference at all. The only place where you get a clinically meaningful difference is at these very extreme levels of depression,” Irving Kirsch tells 60 Minutes. “…The reason they get better is not the chemical in the drug. The difference between drug and placebo is very, very small, and in half of the studies, non-existent… You can get the same benefit without drugs.”
As 60 Minutes notes, Kirsch is “dropping a bomb” on a big business – some $11 billion in annual sales. PhMRA and Eli Lilly, the only drugmaker to respond to the news program, disputed his findings.
Read the Pharmalot article here: http://www.pharmalot.com/2012/02/what-benefit-antidepressants-the-placebo-effect/
Below is the full 60 Minutes Transcript:
60 Minutes
“Treating Depression. Is There a Placebo Effect?”
19 February 2012
The medical community is at war – battling over the scientific research and writings of a psychologist named Irving Kirsch. The fight is about antidepressants, and Kirsch’s questioning of whether they work.
Kirsch’s views are of vital interest to the 17 million Americans who take the drugs, including children as young as six and to the pharmaceutical industry that brings in $11.3 billion a year selling them.
Irving Kirsch is the associate director of the Placebo Studies Program at Harvard Medical School, and he says that his research challenges the very effectiveness of antidepressants.
Irving Kirsch: The difference between the effect of a placebo and the effect of an antidepressant is minimal for most people.
Lesley Stahl: So you’re saying if they took a sugar pill, they’d have the same effect?
Irving Kirsch: They’d have almost as large an effect and whatever difference there would be would be clinically insignificant.
Stahl: But people are getting better taking antidepressants. I know them.
Kirsch: Oh, yes.
Stahl: We all know them.
Kirsch: People get better when they take the drug. But it’s not the chemical ingredients of the drug that are making them better. It’s largely the placebo effect.
Irving Kirsch’s specialty has been the study of the placebo effect: the taking of a dummy pill without any medication in it that creates an expectation of healing that is so powerful, symptoms are actually alleviated.
Kirsch, who’s been studying placebos for 36 years, says “sugar pills” can work miracles.
Kirsch: Placebos are great for treating a number of disorders: irritable bowel syndrome, repetitive strain injuries, ulcers, Parkinson’s disease.
Even traumatic knee pain. In this clinical trial some patients with osteoarthritis underwent knee surgery. While others had their knees merely opened and then sewn right back up.
Kirsch: And here’s what happened. In terms of walking and climbing, the people who got the placebo actually did better–
Stahl: Come on.
Kirsch: –than the people who got the real surgery.
Stahl: No.
Kirsch: And that lasted for a year. At two years after surgery, there was no difference at all between the real surgery and the sham surgery.
Stahl: Is it all in your head or–
Kirsch: Well, it’s not all in your head because the placebos can also affect your body. So if you take a placebo tranquilizer, you’re likely to have a lowering of blood pressure and pulse rate. Placebos can decrease pain. And we know that’s not all in the mind also because we can track that using neuro-imaging in the brain as well.
He says the doctors who prescribe the pills become part of the placebo effect.
Kirsch: A clinician who cares, who takes the time, who listens to you, who asks questions about your condition and pays attention to what you say, that’s the kind of care that can help facilitate a placebo effect.
He says he got into researching the effect of antidepressants by accident.
Kirsch: I was interested in evaluating the size of the placebo effect. I really didn’t even care about the drug effect because everybody, including me, knew it worked. I used to refer patients to get prescriptions. I didn’t change the focus of my work onto looking at the drug effect until I saw the data from our first analysis.
What he saw was that it almost didn’t matter what kind of pill doctors gave patients.
Kirsch: We even looked at drugs that are not considered antidepressants: tranquilizers, barbiturates. And do you know what? They had the same effect as the antidepressants.
Stahl: Come on.
Kirsch: Really.
Kirsch was so surprised by his initial findings, he decided to do a second study – using data not only from the drug companies’ clinical trials that had been published in medical journals.
This time he got data that weren’t published but had been submitted to the FDA, which he got through the Freedom of Information Act.
Kirsch: These are the studies that showed no benefit of the antidepressant over the placebo. What they did is they took the more successful studies, they published most of them. They took their unsuccessful studies and they didn’t publish them.
Stahl: So when you did your study, you put all the trials together?
Kirsch: That’s right.
Stahl: You’re looking at patients who took the real drug and patients who took the placebo.
Kirsch: Yes.
Stahl: Did they get equally better, or did the ones who took the pills get even a little better?
Kirsch: If they were mildly or moderately depressed, you don’t see any real difference at all. The only place where you get a clinically meaningful difference is at these very extreme levels of depression.
Stahl: Now look, psychiatrists say the drug works.
Kirsch: Right.
Stahl: The drug companies and their scientists say the drug works. Maybe you’re wrong.
Kirsch: Maybe. I’d add to that, by the way, patients say the drugs–
Stahl: Patients say the drug works.
Kirsch: –work. And, for the patients and the psychiatrists, it’s clear why they would say the drug works. They take the drug; they get better. Our data show that as well.
Stahl: You’re just saying why they get better.
Kirsch: That’s right. And the reason they get better is not because of the chemicals in the drug. The difference between drug and placebo is very, very small; and in half the studies non-existent.
Kirsch and his studies have triggered a furious counterattack – mainly from psychiatrists, who are lining up to defend the use of antidepressants like Dr. Michael Thase, a professor of psychiatry at the University of Pennsylvania School of Medicine, who has been a consultant to many of the drug companies.
Stahl: Irving Kirsch says that depressants are no better than placebo for the vast majority of people with depression, the vast majority. Do you agree with that?
Michael Thase: No, no. I don’t agree. I think you’re confusing, or he’s confusing, the results of studies versus what goes on in practice.
He says that Kirsch’s statistical analysis overlooks the benefits to individual patients.
And while he agrees there’s a substantial placebo effect –
Especially for the mildly depressed, using a different methodology, he finds that the drugs help 14 percent of those moderately depressed, and even more for those severely depressed.
Thase: Our own work indicates pretty convincingly that this is a large and meaningful effect for a subset of the patients in these studies.
Stahl: But even by your own numbers more people, maybe twice as many people, are having a placebo effect than are actually being helped by the drug.
Thase: That’s correct.
Stahl: In the moderate range?
Thase: That’s correct.
Stahl: And this isn’t troubling to you?
Thase: I wish our antidepressants were stronger. I hope we have better ones in the future. But that 14 percent advantage over and above the placebo is for a condition that afflicts millions of people, that represents hundreds of thousands of people who are better parents, who are better workers, who are happier and who are less likely to take their life.
Since the introduction of Prozac in the 1980s, prescriptions for these drugs have soared 400 percent –
[Commercial: I used to be happy, I remember being happy…]
— with the drug companies having spent billions over the years advertising them.
Stahl: I don’t know about you, but I’m seeing more women running through daisy fields after looking morose than ever before.
Dr. Walter Brown: Absolutely. There’s a lot of hype out there.
Dr. Walter Brown is a clinical professor of psychiatry at Brown University’s Medical School. He has co-authored two studies that largely corroborate Kirsch’s findings.
Brown: The number of antidepressant prescriptions over the last decade has increased and most troublesome, the biggest increase is in the mildly depressed, who are the ones who are least likely to benefit from them.
He says they’re getting virtually no benefit from the chemical in the pill. Like most experts, he says these drugs do work for the severely depressed, but he questions the widely held theory that depression is caused by a deficiency in the brain chemical called serotonin, which most of these pills target.
Brown: The experts in the field now believe that that theory is a gross oversimplification and probably is not correct.
Stahl: And the whole idea of antidepressants is built around this theory?
Brown: Yes, it is.
To approve any drug, the Food and Drug Administration merely requires that companies show their pill is more effective than a placebo in two clinical trials – even if many other drug trials failed.
Brown: The FDA for antidepressants has a fairly low bar. A new drug can be no better than placebo in 10 trials, but if two trials show it to be better, it gets approved.
Stahl: Does that make sense to you?
Brown: That’s not the way I would do it if I were the king. But I’m not.
Dr. Tom Laughren, director of the FDA’s division of psychiatry products, defends the approval process.
Stahl: We’re told you discard the negatives. Is that not right?
Tom Laughren: We consider everything that we have. We look at those trials individually–
Stahl: But how are you knowing that the two positives deserve bigger strength in the decision?
Laughren: Getting that finding of a positive study by chance, if there isn’t really an effect, is very low. I mean, that’s basic statistics and that’s the way clinical trials are interpreted. A separate question is whether or not the effect that you’re seeing is clinically relevant.
Stahl: Okay. Is it clinically relevant?
Laughren: The data that we have shows that the drugs are effective.
Stahl: But what about the degree of effectiveness?
Laughren: I think we all agree that the changes that you see in the short-term trials, the difference between improvement in drug and placebo is rather small.
Stahl: It’s a moderate difference.
Laughren: It’s a small, it’s a modest difference.
It’s so modest – that in Great Britain the National Health Service decided to dramatically revamp the way these drugs are prescribed. It did so after commissioning its own review of clinical trials.
Tim Kendall: We came to the conclusion that for mild to moderate depression, these drugs probably weren’t worth having.
Stahl: At all.
Kendall: Not really.
Dr. Tim Kendall, a practicing psychiatrist and co-director of the commission that did the review says that like Irving Kirsch – they were surprised by what they found in the drug companies’ unpublished data.
Kendall: With the published evidence, it significantly overestimated the effectiveness of these drugs and it underestimated the side effects.
Stahl: The FDA would say that some of these unpublished studies are unpublished because there were flaws in the way the trials were conducted.
Kendall: This is a multibillion dollar industry. I doubt that they are spending $10 million per trial to come up with a poor methodology. What characterizes the unpublished is that they’re negative. Now I don’t think it’s that their method is somehow wrong; it’s that their outcome is not suitable from the company’s point of view.
Because of the review, new public health guidelines were issued. Now drugs are given only to the severely depressed as the first line of treatment. For those with mild to moderate depression, the British government is spending nearly half a billion dollars training an army of talk therapists.
[Instructor: If you wanna go a little faster, you can.]
Physical exercise is another treatment prescribed for the mildly depressed.
Kendall: By the end of 10 weeks, you get just as good a change in their depression scores, as you do at the end of 10 or 12 weeks with an antidepressant.
None of the drug companies we spoke to was willing to go on camera, but Eli Lilly told us in an email that drug trials show antidepressants work better than placebos over the long term and that “numerous studies have shown that patients on placebos are more likely to relapse” back into depression. The industry’s trade association, PhRMA, wrote us: “antidepressants have been shown to be tremendously effective.”
But if Irving Kirsch has his way, the drug companies will have to completely rethink their $11.3 billion business.
Stahl: You’re throwing a bomb into this. This is huge what you’re saying.
Kirsch: I know that. The problem is that you can get the same benefit without drugs. I think more are beginning to agree. And I think things have begun to change.
Everyone in this story says that if you’re depressed, you should see your doctor, and if you’re already on these powerful drugs, you shouldn’t stop taking them on your own.