Monday, November 19, 2012

causal fallacies

A causal fallacy involves making the claim that something (call it 'x') causes something else (call it 'y') when the evidence presented is insufficient to establish either that x is a necessary condition for y or that x is a sufficient condition for y. Causal fallacies usually involve either post hoc reasoning or jumping to a conclusion based on finding a correlation between x and y. The post hoc fallacy (that x causes y because x came before y) is discussed elsewhere. Here I'll focus on errors due to misapplied correlation.

Let's start with an example of some good causal reasoning. The claim that smoking causes lung cancer is based on data that demonstrate to a high degree of probability that had a person with lung cancer not smoked they would not have the kind of cancer they have today. We describe such a relationship as that of smoking to lung cancer as being of the type smoking is a necessary condition for lung cancer. Expressing it this way can be misleading though, so some explanation if required. Certainly, people who have never smoked can get lung cancer, so in that sense it is not necessary to smoke in order to get lung cancer. When we say that smoking is a necessary condition for lung cancer we mean that for the particular cancer a person has smoking was necessary. In simpler terms, this means that had the person not smoked they would not have gotten the kind of lung cancer that is caused by smoking.


How would one go about showing that smoking causes cancer, i.e., is a necessary condition for cancer? You begin by making predictions and testing them. For example, if smoking causes cancer then you would expect that if you randomly selected 100,000 people, divided them into smokers and non-smokers and observed them over a 20-year period, you should find a significantly greater number of lung cancer cases in the smoking group. Significance is measured by a statistical formula that basically says that it is highly unlikely that the difference between the two groups is due to chance. Many more predictions should be tested before jumping to the conclusion that smoking causes lung cancer. These predictions might take into account how long people have smoked; how many cigarettes a day they smoked; if they quit smoking, how long has it been; etc.

Establishing causality requires more than just finding a statistic that is consistent with the hypothesis that x causes y, however. For example, you might find that 30 out of 30 men in a West Virginia lung cancer ward all worked in the coal mines. From that you might infer that coal dust causes lung cancer. But what if you also find out that all 30 were smokers? That makes the issue a bit more complicated. Perhaps coal dust contributes to lung cancer or perhaps smoking alone can account for these cancers. Further predictions would have to be tested to try to tease out the role, if any,  of coal dust in lung cancer.

A correlation between x and y must exist if x and y are causally related. That is, it must be the case that x is generally followed by y or that y is generally preceded by x, that as x increases or decreases so does y, or that as x increases, y decreases. Finding a correlation between x and y, however, does not mean they are causally related. There are very good correlations between age and shoe size, hat size, height, and weight, but age doesn't cause any of these things.

One problem with claiming a causal relationship based solely on a strong correlation is that in addition to a causal connection there are at least three other plausible explanations for the correlation. One, it could be a fluke. Two, there might be a causal relationship, but the correlation can't tell you which is the cause and which the effect. For example, you might find a good correlation between the increase in sex education classes for high school students and an increase in teenage pregnancies. But you have no way of knowing just from the correlation whether this is a coincidence, whether the sex ed classes stimulated interest in sexual activity leading to increased pregnancies, or whether the increase in pregnancies prompted school officials to add more sex education classes.

Three, there might be a causal relation involved but not x causes y or y causes x. Rather, it might be the case that z causes both x and y, or that z and x cause y (or z and y cause x). For example, there might be a good correlation between taking birth control pills and developing blood clots in women of a certain age group, but when controlled for smoking the correlation between taking birth control pills and developing blood clots might go away. In a study on this issue, it was found that smoking plus taking birth control pills increased the chances of blood clots more than just smoking did, while those who did not smoke but took the pill had no greater frequency of blood clots that women in general (Ronald Giere, Understanding Scientific Reasoning, [1996] 297-303).

On the other hand, if x and y are causally related there should be a good correlation between them, which allows us to make predictions that test the hypothesis x causes y. For example, if cell phone use causes brain tumors then we should find a significantly greater number of brain tumors among cell phone users compared to those who don't use cell phones. No data yet has supported this claim, which strongly indicates that cell phone use isn't a significant causal factor for brain tumors. However, had we found a strong correlation between cell phone use and brain tumors, that would confirm our hypothesis but it would not be enough evidence to establish a causal connection. Before jumping to the conclusion that cell phones cause brain tumors we would need to do two things: one, we must rule out other plausible causes for the correlation and two, we would need to make more testable predictions that ideally would be more rigorous than the original test.

Many people consider the randomized control group study to be the gold standard in science, especially in medicine. But since there are many variables that can affect the outcome of a controlled study, it is important that we not put too much faith in a single study, especially if the study is small and involves multiple outcomes. For example, the Sicher-Targ distant healing study involved only 40 subjects and looked at 23 possible outcomes for AIDS patients, some of whom were prayed for and some of whom weren't prayed for by a special group of praying people. Finding a significant correlation between a few of the 23 possible outcomes, even for a small experimental group of 20 subjects, is expected by the laws of chance and should not be taken to indicate any kind of causal relationship between the praying and the few outcomes that correlated significantly.

Probably the most common causal error is to conclude that because test results confirm a hypothesis, the hypothesis is established to a significant degree of probability. As long as other plausible explanations can't be ruled out, finding that an experimental result is just what you predicted if your hypothesis is correct means only that your hypothesis can't be ruled out. A prime example of this kind of faulty reasoning permeates more than a century of experimentation by parapsychologists in their quest to prove ESP and psychokinesis. I have discussed this elsewhere under the heading of the psi assumption.

Briefly, the psi assumption is the assumption that any significant departure from the laws of chance in a test of psychic ability is evidence that something anomalous or paranormal has occurred. Departure from the laws of chance would be consistent with the psi hypothesis, but until all other plausible explanations have been ruled out, it is hasty to conclude that evidence for psi has been found. There are several plausible explanations for the data in psi experiments. Cheating by subjects is commonplace. Fraud by experimenters is rare, but it has happened (e.g., the Soal-Goldney experiment [1941-1943]). Methodological errors and sloppiness have occurred in experiments that have been hailed as slam-dunk proof by parapsychologists like Dean Radin. For example, Susan Blackmore was appalled when she visited the lab of Carl Sargent, whose work played a major role in the ganzfeld studies of Bem and Honorton.

....I went to visit Sargent's laboratory in Cambridge where some of the best ganzfeld results were then being obtained. Note that in Honorton's database nine of the twenty-eight experiments came from Sargent's lab. What I found there had a profound effect on my confidence in the whole field and in published claims of successful experiments.
These experiments, which looked so beautifully designed in print, were in fact open to fraud or error in several ways, and indeed I detected several errors and failures to follow the protocol while I was there. I concluded that the published papers gave an unfair impression of the experiments and that the results could not be relied upon as evidence for psi. (Blackmore 1987)

Other errors, such a sensory leakage and experimenter effects, questionable methodologies such as displacement and psi missing, and misapplication of statistics must all be considered before jumping to the conclusion that a statistic that is unlikely due to chance according to some arbitrary formula is proof of anything paranormal.

Another area where it is common to mistake correlation for causation is in medicine. Two examples stand out: both involve using MRIs. When the MRI became widely available in the late 1980s, doctors began using them on patients complaining of severe back pain. The MRIs showed many things, including spinal discs that appeared degenerated in people with severe back pain. Doctors concluded that the pain was being caused by the abnormalities in the discs. Prior to the use of the MRI, the most common treatment for back pain was no treatment at all. Most back pain goes away on its own. After the introduction of the MRI, various kinds of surgical procedures were done to alleviate the pain assumed to be caused by the bulging or herniated disc. Before jumping to the conclusion that the abnormal discs were causing the back pain, scientists should have done MRIs on people who don't have any back pain. This was finally done in 1994 on ninety-eight people. They went to the doctor, got an MRI, and two-thirds of them had abnormalities in their discs. Maybe the bulging discs had nothing to do with the pain (Lehrer, Jonah. How We Decide, pp. 160-163). MRIs, it turns out, "find abnormalities in everybody" (How Doctors Think, Jerome Groopman).

The other example involves the overuse of MRIs for injured athletes. Baseball pitchers with injured arms, for example, are often advised to have surgery based on an MRI that finds abnormalities. Dr. James Andrews, a widely known sports medicine orthopedist in Gulf Breeze, Fla., wanted to test his suspicion that MRIs might be misleading. He scanned the shoulders of 31 perfectly healthy professional baseball pitchers. The pitchers were not injured and had no pain. But the MRIs found abnormal shoulder cartilage in 90 percent of them and abnormal rotator cuff tendons in 87 percent. This finding strongly indicates that the abnormalities seen in the MRIs were not causing the pitchers' pain.

Epidemiologists are particularly prone to making hasty judgments about causal connections based on correlations. An epidemiologist describes the problem:

...there is an ongoing national study of a chemical in plastic that is in EVERYTHING and EVERYONE. It is ubiquitous and it is a chemical, so something bad may be happening to us. So epidemiologists are asking what diseases might be associated with this chemical. And true to form, they are looking at every disease possible…exploring hundreds of diseases known to man to see if there is a statistical link to the chemical. Even before they start, we know they will find one or many links. If one disease is found that appears to be linked and the calculated statistic of p < or = to 0.05 is present, then the press release goes out that the chemical causes some horrible cancer or some toes to fall off. Everyone panics and goes to REI to buy chemical free plastic water bottles. Of course, the call will be for further studies. Those studies show the findings can’t be replicated. But those follow-up negative studies don’t get published and only make page 15 in the newspaper rather than page one. AND the damage is already done as the plastic industry tanks, the toe falling off attorneys are lining up and everyone starts limping for effect. ("Problems in Epidemiology land" by Dr. Ward Robinson)

Finally, there are some parapsychologists who have found correlations between what they consider to be important events that catch the attention of many people (such as the death of a princess) and blips on random number generators (RNGs). These folks call their work the global consciousness project and they are led by people like Dean Radin and Roger Nelson. Radin and Nelson think that when groups of people focus their minds on the same thing, they influence “the world at large” and this influence is shown by blips on RNG machines. In addition to basing a causal connection on nothing but a correlation, these fellows are guilty of selection bias, a problem that plagues epidemiologists as well.

19 comments:

  1. This is not clearly expressed: the statement "[S]moking is a necessary condition for lung cancer" is contradicted by the statement "Certainly, people who have never smoked can get lung cancer, so in that sense it is not necessary to smoke in order to get lung cancer." Both statements relate to the general population, but you then substitute a different set of circumstances by narrowing down a statement to one particular case: "[W]e mean that for the particular cancer a person has smoking was necessary." This is the equivalent of "Smoking is a necessary condition for this case of lung cancer." That's not the same thing at all.

    ReplyDelete
    Replies
    1. The reference to "the particular person" is not a single person but to anyone who has lung cancer caused by smoking.

      Delete
  2. Reading the first two paragraphs made me realize that I am a fool for ever smoking. Whether smoker's have legal causation or not there is always a choice to quit at any time. This is a very interesting case and hope to learn more.

    ReplyDelete
  3. The blog is good enough I again n again read this.Aspire Atlantis

    ReplyDelete
  4. Brilliant illustexcellentd facts. I thanks approximately that. no question it is going to be very useful for my destiny projects. would really like to look a few different posts at the identical difficulty! Gmod game

    ReplyDelete
  5. Uptime is one of the most important factors in maintaining an effective online presence. Outages of any duration can be costly. Downtime can impact your organization directly by causing lost sales, signups, etc., or indirectly by hurting your reputation and brand image.Casual Shoes men

    ReplyDelete
  6. Success on the internet is what you are after. This assumption is based on two facts; that you are taking the time out to read this article, and the fact that more and more people are now realizing that the internet is a potential goldmine. mens casual dress shoes

    ReplyDelete
  7. This comment has been removed by the author.

    ReplyDelete
  8. Men seek out the escorts and try to fulfill their wishes. Most of them just want to employ them as a friend, while others want them to be their dance partner or to be with them at lunch dates. For you, call girls in vasant kunj meet all your needs. The escorts provide a wide range of services to the men.

    ReplyDelete
  9. We offer busty, petite and model looking escorts Mumbai. Great services and reputation.Mumbai Escort
    website. In calls Out calls Mumbai escort service .our escort girls provide a 1st class experience for
    gentlemen.We offer busty, petite and model looking escorts. Mumbai Russian escorts and reputation.
    http://www.mumbaibeautygirls.com/

    ReplyDelete
  10. If you're trying to burn fat then you need to start using this brand new personalized keto diet.

    To design this service, certified nutritionists, fitness couches, and top chefs have united to develop keto meal plans that are useful, painless, money-efficient, and enjoyable.

    From their launch in early 2019, thousands of clients have already completely transformed their body and well-being with the benefits a smart keto diet can provide.

    Speaking of benefits: in this link, you'll discover 8 scientifically-tested ones given by the keto diet.

    ReplyDelete
  11. This way my friend Wesley Virgin's biography begins with this shocking and controversial VIDEO.

    You see, Wesley was in the military-and shortly after leaving-he discovered hidden, "SELF MIND CONTROL" secrets that the government and others used to get anything they want.

    THESE are the exact same tactics many famous people (notably those who "come out of nowhere") and top business people used to become wealthy and successful.

    You probably know that you utilize only 10% of your brain.

    Mostly, that's because the majority of your brainpower is UNCONSCIOUS.

    Perhaps that conversation has even taken place IN YOUR own brain... as it did in my good friend Wesley Virgin's brain 7 years back, while driving an unregistered, beat-up bucket of a car with a suspended license and $3 on his banking card.

    "I'm absolutely frustrated with living payroll to payroll! When will I finally make it?"

    You took part in those types of questions, isn't it so?

    Your success story is waiting to happen. Go and take a leap of faith in YOURSELF.

    CLICK HERE TO LEARN WESLEY'S SECRETS

    ReplyDelete
  12. Your Affiliate Money Printing Machine is waiting -

    Plus, making profit with it is as easy as 1..2..3!

    Here is how it works...

    STEP 1. Tell the system what affiliate products the system will promote
    STEP 2. Add push button traffic (this ONLY takes 2 minutes)
    STEP 3. See how the system grow your list and upsell your affiliate products on it's own!

    Are you ready to make money automatically?

    You can test-drive the system for yourself risk free...

    ReplyDelete
  13. Wow what a great blog, i really enjoyed reading this, good luck in your work. Gay sexting forum

    ReplyDelete
  14. DR EMU WHO HELP PEOPLE IN ANY TYPE OF LOTTERY NUMBERS
    It is a very hard situation when playing the lottery and never won, or keep winning low fund not up to 100 bucks, i have been a victim of such a tough life, the biggest fund i have ever won was 100 bucks, and i have been playing lottery for almost 12 years now, things suddenly change the moment i came across a secret online, a testimony of a spell caster called dr emu, who help people in any type of lottery numbers, i was not easily convinced, but i decided to give try, now i am a proud lottery winner with the help of dr emu, i won $1,000.0000.00 and i am making this known to every one out there who have been trying all day to win the lottery, believe me this is the only way to win the lottery.

    Contact him on email Emutemple@gmail.com
    What's app +2347012841542
    Website Https://emutemple.wordpress.com/
    Https://web.facebook.com/Emu-Temple-104891335203341

    ReplyDelete
  15. My dad was diagnosed with Parkinson's disease his symptoms were shuffling of feet,slurred speech, low volume speech, degradation of hand writing, horrible driving skills, right arm held at 45 degree angle, but now he finally free from the disease with the help of total cure from ULTIMATE LIFE CLINIC, he now walks properly and all symptoms has reversed, he had trouble with balance especially at night, getting into the shower and exiting it is difficult,getting into bed is also another thing he finds impossible.we had to find a better solution for his condition which has really helped him a lot,the biggest helped we had was ultimate life clinic they walked us through the proper steps,am highly recommended this www.ultimatelifeclinic.com to anyone who needs help.

    ReplyDelete
  16. Rent a car in Agadir to freely explore its sunny beaches and picturesque landscapes. Our wide range of vehicles provides you with choice and flexibility to fully enjoy your stay in this magnificent region of Morocco.

    locationvoituresagadir.com

    ReplyDelete