1. Mick West

    Mick West Administrator Staff Member


    Scientists take chocolate, which is then blessed in various ways (by the mediators themselves, a Tibeten shaman, or an intention recording and playback device). The chocolate is then eaten for a week by four groups of 15 people, and their degree of mood disturbance is recorded every day. The results are pretty much the random walk you would expect from such small sample sizes.


    On day five, some people in the control group were evidently having a bad day. The researchers take this as a significant result.

    The "P-value" is basically the probability that the results might have been the result of chance, if all other variables are eliminated. The researchers ignore the facts that the groups were actually very different (inevitably, as there were only 15 people in each group), and experienced very different weeks. If you were to take 60 people in San Francisco at random, and separated them out into four groups of 15, you'd likely get very different groups. And a group of 15 (the control) is likely to vary more than a group of 45 (the average of the "intention" groups). So, yes, it is actually easily attributable to chance.

    What really struck me though, was the extraordinary "get out of criticism free" clause at the end of the paper.

    So in order for the experiment to work:

    • All partipants must believe it works
    • Everyone aware of the experiment must believe it works (even if they don't participate, or are even nearby)
    • You must tell nobody skeptical about the experiment in the future, or their skepticism will travel back in time, and negate the results.

    Basically, every time the experiment does not work - then it's because someone was skeptical, somewhere in the world, and possibly hundreds of years in the future.
    Last edited: Nov 20, 2013
  2. Mick West

    Mick West Administrator Staff Member

    But in the study everyone was given the same amount of chocolate, just some of it was "blessed" more than others. It's rather fringe science.

    I think chocolate cheers people up momentarily because it's so yummy. :)
  3. Vinncent

    Vinncent New Member

    I just heard about this study a short time ago.

    With any strange and probably controversial study, the first thing I do after reading it is immediately search for criticisms against said study, in case there were any fundamental problems with them that I couldn't see myself.

    You have one decent criticism... the number of participants is too small to consider the study "significant", and needs replication with a larger number of participants to help rule out uncontrolled variables associated with differences between individuals and all the random happenstances of their lives.

    The rest of your criticisms are plain wrong.

    1) All partipants must believe it works.

    No. As stated in the article, and you quoted,

    "both the participants and investigators should ap- proach this experiment critically—but genuinely open—to the hypothesis."

    The researchers are advocating a skeptical attitude, which is pretty fundamental in science. What they are -not- advocating is blind acceptance, or dismissal, of a hypothesis before the experiment has finished. To say skepticism = belief is, quite simply, a lie.

    2) Everyone aware of the experiment must believe it works (even if they don't participate, or are even nearby)

    See 1). Additionally, the experiment is specifically testing the effect that conscious intent, or "blessing" has on chocolate, from those actively "intending(?)" the chocolate. If the researchers are "intending" either a positive -or- negative effect on the chocolate in question, then you are no longer testing the effect that the group of "blessers" has on the chocolate, but are now testing the effect that both researchers and "blessers" have on the chocolate, and are now conducting a completely different experiment.

    Furthermore, in an experiment that is literally testing the effect of "intention" on chocolate, an experiment that involved a group of people "positively intentioning" the chocolate, with a group of researchers actively setting out to prove the experiment bullshit, "negatively intentioning" the chocolate and failing to note their own negative intent in the report, could easily nullify an experiment that, again, revolves around the role of "intention".

    3) You must tell nobody skeptical about the experiment in the future, or their skepticism will travel back in time, and negate the results.

    This is kind of a separate argument... I'm only vaguely familiar with research done on retrocausality, and am not sold on it one way or the other. But this does not "debunk" the experiment... it is simply one of the controls of the experiment they decided to include based on other research they thought relevant. It might very well not be a relevant factor in the slightest... another experiment with two more groups, "blessed" and "unblessed" chocolate and telling people about it in the future (with a larger number of participants, of course) could establish whether "retrocausality" has any effect on the result. But this in no way "debunks" the experiment posted, it would only give evidence for, or debunk, the relevance of "retrocausality" as a factor.
  4. Mick West

    Mick West Administrator Staff Member

    The point is that it gives them an "out" if there is any result that disagrees with their expectations. Since you can't really test the expectations of the experimenters, or people around them or readers in the future, then you can always claim a negative result was influenced by some unbelievers.

    All of which would be irrelevant if they actually got a positive result. And yet they spend all their time explaining why negative results don't disprove anything.
  5. Vinncent

    Vinncent New Member

    I can see why you would make the jump from "active disbelief can ruin the experiment" to "he will claim that any failed replication of this experiment is due to experimenter bias", but that's a rather premature criticism. It is merely a relevant (and and unusual one, given the nature of this study compared to others) variable that other researchers might fail to take into account, on the off chance anyone else bothers to perform this experiment again. It seems as though a simple double-blind would eliminate that potential effect (have people who -aren't- the original researchers buy the chocolate and interact with the "blessers" for them). That way, a negative replication couldn't reasonably be due to the "intention" of the researchers interacting with the chocolate in any way at any point in time. It appears the original study also used double-blinds. It doesn't seem to be an "out"... so much as, "This is a fundamental point to pay attention to for anyone attempting to replicate the experiment."

    (Unless Radin were to later claim that "the disbelief in the healing power of chocolate from any person, at any time, anywhere, who have never seen, touched, or interacted with the experimental chocolate will ruin the experiment", which would be silly, and does not appear to be the case.)

    It looks like you also only posted the results of only one of groups tested... the one with a P value of 0.04, which is not significant. Analysis of the other groups in the article show P values of 0.004 and 0.001... pretty significant, so it appears there was a positive result.

    Semantically, it would be a waste of time arguing "how much time spent discussing why negative results might not disprove the experiment", but it certainly isn't "all their time". A significant amount of time is spent dealing with alternative explanations as to why the result can't be attributed to explanations beyond the "blessing" variable.

    I highly doubt anyone will try replicating the experiment... but the results would seem to suggest "We should do this again with a larger group of people", not "This didn't work and is a waste of time".
  6. FuzzyUK

    FuzzyUK Member

    But chocolate is supposed to emulate the feelings of highs associated with sex. So surely the results are invalid unless one abstains from sexual activity for a week?