Monday, April 9, 2012

clustering illusion

In 2003, the mother of a child with leukemia in the Sacramento area thought it odd that there were several other people with cancer in her neighborhood. She did a survey and found what appeared to be an excessive number of cancers in the area. I can understand the woman’s desire to find something to blame for her child’s illness and I can also understand how the average person might be led to think that there must be something in the local environment that is causing the cancers. However, several things should be considered.

The woman’s boundaries extended to wherever she arbitrarily decided to draw them. She included all kinds of cancers in her survey, not just leukemia. She included people who had lived in the area for various amounts of time, ranging from having been born there to having moved into the area in adulthood.

Epidemiologists tried to explain that when you looked at the numbers, they weren’t that unusual and didn’t warrant investigation into an environmental cause. The data showed no difference in the leukemia rates in her area than in the rest of the Sacramento region. The Sacramento Bee took up her cause and eventually there was an official government analysis of the water supply that found no environmental toxins in the water. Still, the Bee persisted and identified tungsten found in tree rings as the probable culprit, even though tungsten is not a known human carcinogen and the connection between tungsten in trees and cancer in humans is speculative.

What the Bee and their experts were calling "a cancer cluster" is considered an example of the clustering illusion by epidemiologists: the intuition that random events which occur in clusters are not really random events. To some, the occurrence of a number of cancers in a defined space cries out for a causal explanation in terms of some unknown environmental hazard. To others, familiar with the data and knowledgeable of proper statistical analysis, the same number of cancers occurring within the same defined space is expected by the laws of chance.

The Centers for Disease Control investigated 108 cancer clusters between 1961 and 1990. None could be linked with environmental causes. It may seem improbable, but the chances are better than even that a given neighborhood in California will have a statistically significant cluster of cancer cases.

The clustering illusion is due to selective thinking based on a counterintuitive but false assumption regarding statistical odds. For example, it strikes most people as unexpected if heads comes up four times in a row during a series of coin flips. However, in a series of 20 flips, there is a 50% chance of getting four heads in a row. In any short run of coin flips, a wide variety of probabilities are expected, including some runs that seem highly improbable.

Sometimes a subject in an ESP experiment or a dowser might be correct at a higher than chance rate over a limited period of time. However, such results do not indicate that an event is not a chance event. In fact, such results are predictable by the laws of chance. Rather than being signs of non-randomness, they are actually signs of randomness. ESP researchers are especially prone to take streaks of "hits" by their subjects as evidence that psychic power varies from time to time.

A classic study done on the clustering illusion demonstrates just how hardheaded we are when it comes to facing facts that don’t support our beliefs. The study was done by Thomas Gilovich and some colleagues. It centered on the belief in the “hot hand” in basketball. It is commonly believed by basketball players, coaches, and fans that players have “hot streaks” and “cold streaks.” A detailed analysis was done of the Philadelphia 76ers during the 1980-81 season. It failed to show that players hit or miss shots in clusters at anything other than what would be expected by chance. Gilovich et al. also analyzed free throws by the Boston Celtics over two seasons and found that when a player made his first shot, he made the second shot 75% of the time and when he missed the first shot he made the second shot 75% of the time. Basketball players do shoot in streaks, but within the bounds of chance. It is an illusion that players are ‘hot’ or ‘cold’. When presented with this evidence, believers in the “hot hand” are likely to reject it because they “know better” from experience.


  1. In so many fields of study even in real life manufacturing people often alter the truth by wanting their result to show they are right. People need to be open minded and use critical thinking when looking at any result and even when setting up tests it can be done with bias. The paranormal research going on now is based on a false belief. People already have preconceived ideas so that is what they will find.

    1. Great Article Cyber Security Projects projects for cse Networking Security Projects JavaScript Training in Chennai JavaScript Training in Chennai The Angular Training covers a wide range of topics including Components, Angular Directives, Angular Services, Pipes, security fundamentals, Routing, and Angular programmability. The new Angular TRaining will lay the foundation you need to specialise in Single Page Application developer. Angular Training

  2. Everyone with a pharmacist's degree does no longer become going for walks at the local drugstore allotting prescriptions and providing sage recommendation. Gmod game

  3. The blogging scene has become more worldwide than ever, with a vast array of competitive topics. Even with the ever-rising social networks, the BLOG will always have its distinct place on the Internet. In retrospect, what platforms are more widely used than shoes in Pakistan

  4. If you are thinking about having your own website designed for your home-based business, or any small business, there are many considerations going through your mind. If your business is relatively young, you want to portray a professional and basic image in your website.Formal Shoes

  5. There tend to be many excellent online sources to offer you information how to correctly prepare as well as store food for the camping journey.cambridge real estate

  6. Shen Tong is a serial entrepreneur and an angel investor. Shen Tong graduated from the University of Peking in the year 2000. In order to focus on business, Shen Tong moved to the city of New York where he found food accelerators like Food-X and FoodFutureCo.Shen Tong
    also has made a number of commercial investments in New York which have an impact. Shen Tong is the co-founder of a committee specifically designed for negotiations for the Chinese pro-democracy movements.Shen Tong
    provides instrumental senior management in investments for publishing in the city of Beijing.Shen Tong
    also organized the democracy movement in 1989 that occupied Tiananmen Square while he was at Beijing University. In the year 2011,Shen Tong participated in the occupy wall street movement. Shen Tong was also considered as the main proponent for non-violence.Shen Tong also held a press conference at the Walker Center for Ecumenical Exchange in Newton Massachusetts.


  7. Looking for best bars in Delhi to quench the weekend thirst, or just need some of the best pubs in delhi for enjoying evenings after long days at work. Choosing a place drink eBay celebrate should not be a difficult task. There are some things that are important while deciding about where shall you drink. The bar or the clubs should be close, economical, not congested & should also offer good food. But how can you find this information? It's actually quite simple. Just Download Boozeey Smartphone app for your smartphone.

    boozeey will immediately give you the list of best bars in Delhi from the nearby area & show you their drinks menu & prices. So never waste time ever again by going to multiple bars or pubs, #justBoozeey. Not only does the boozeey app helps you to find the best pubs & bars it will also give you great discounts with features like first drink free every night & happy hours anytime. Check it out on App Store & Google Play & discover for yourself the easiest & the most economical way to enjoy parties at best bars in Delhi.

    Not only your party experience is better with -boozeey but Boozeey takes care of a safe ride home for you. The Boozeey app has in-built OLA cabs integration that will allow you to book an OLA cab to reach or depart from the bar location. So if you are living in Delhi NCR download the -boozeey app & enjoy exclusive access to best bars & pubs in Delhi.

  8. This comment has been removed by the author.

  9. Dental Services in New Jersey since 1998-Hamilton Dental Care. Offers a variety of dental services in Hamilton to meet all of your dental needs. Let’s say if you are searching for the cosmetic dentistry near me or cosmetic dentistry hamilton NJ then you might come across with the Hamilton Dental Care because it is the best dental health services provider in the NJ. It gives you a smile that you can be proud to show off

  10. Excel Dental - Dentist in Langhorne offers cosmetic dentistry procedures, restorative dentistry, affordable dental implants including mini dental implants as well as full dental implant in Langhorne, Pennsylvania. Book your dental appointment for teeth whitening for any cosmetic procedures in Langhorne, Pennsylvania if you are searching for a general dentist near methen you might come across with Excel Dental Langhorne because of its best dentist in Langhorne

  11. Affordable online boutique - Bermere is a leading online store for the fashion lover women, and it offers classy, designer and trendy outfits at economical prices the women of every age group. Online boutique tops, dresses, jumpsuits, rompers, two-piece sets, and outwear available here are perfect for your office, night outs, parties and more. Besides, the add-on accessories for women like jewelry, scrunchies, and scarves can add more to your style. In addition to all this, Bermere - Affordable Online Boutique has expertise in seasonal clothing. To get the finest online boutique tops, summer dresses, and trendy sweaters visit our affordable online boutique store and give you the perfect style you desire.

  12. 24*7 mobile truck repair in Atlanta.. Premium Truck and Trailer Repair LLC all the truck repair, trailer repair, services in Conley, Atlanta. Premium Truck and Trailer Repair LLC offers high quality and cost effective truck and trailer repair services. Our professional truck repair near me can fix your heavy duty truck and trailer for hassle free travel.

  13. immigration law firm NJ providing legal services and representation to clients throughout the state and region. The firm’s practice areas encompass Corporate Law, family law, divorce, and DACA. Our experience enables us to provide the best solutions through creative ways and specific strategies tailored to your legal matter.

  14. I was diagnosed as HEPATITIS B carrier in 2013 with fibrosis of the
    liver already present. I started on antiviral medications which
    reduced the viral load initially. After a couple of years the virus
    became resistant. I started on HEPATITIS B Herbal treatment from
    ULTIMATE LIFE CLINIC ( in March, 2020. Their
    treatment totally reversed the virus. I did another blood test after
    the 6 months long treatment and tested negative to the virus. Amazing
    treatment! This treatment is a breakthrough for all HBV carriers.