Right on cue! I was expecting to debate this on the Flying Spaghetti Monster, but I'll take your Palomar psychic challenge — potato/potahto.
That's actually a great illustration of the difference between unbounded speculation and bounded hypothesis testing.
If you understand why you put paranormal powers, the Matrix and supernatural entities into the unbounded speculations, you may possibly understand why I put 'alien satellites' in the same category. Hint: all the evidences we have argue for a near-to-nihil probability for paranormal, the Matrix and the supernatural. All the evidences we have argue for a near-to-nihil probability of visiting aliens (go figure for alien satellites monitoring nuclear tests on Earth, often from the opposite side of the planet, and only for a limited period of time after which they disappeared). Yes, supernatural entities are much more near-to-nihil than aliens, but both near-to-nihil they are.
Villarroel et al. didn't "close their hypothesis space" to Palomar psychics or demonic light shows; they constrained it to testable natural explanations — instrumental, astronomical, or physical. That's the key difference between science and satire: a hypothesis only earns a place in the model if it can, in principle, be falsified.
Do you think psychic powers or supernatural entities are
not testable? If people could routinely move objects by the power of their mind, that would be pretty much testable (I'd even bet we'd have a specific branch of physics with nice equations for this). If supernatural entities commonly appeared and, say, made people levitate in the air that would be very much testable. Villaroel et al. just constrained their hypothesis space to the hypothesis they liked more, exactly the opposite of an open-minded approach.
By the way, the paranormal hypothesis I stated before perfectly explains why the transients disappeared in later obervations (the psychic died, or he/she got used to nuclear tests and did not get so upset anymore...). It naturally explains the data much better than Villaroel at al.'s. The Matrix glitches do the same: once the hardware/software update was in place and debugged the glitches disappeared. So neat!
And yet, as Kuhn reminded us, entire paradigms have flipped when ideas once dismissed as "absurd" turned out to be right — germs, continental drift, the Big Bang. Reflexive dismissal has a poor track record.
Oh yes, surely that happens! But.. they are famous cases because they are so
rare. The overwhelming majority of ideas have been rejected (even those who were not 'absurd' at all, ie.: Earth is flat). What you said is just a form of the
Galileo gambit.
So no, we don't need to test for supernatural agencies,
I agree of course, but ask yourself:
why we don't have to bother with supernatural explanations? Do we need to test for psychics powers? For the Matrix? For extradimensional Bigfoots? For aliens who succeeded in sending a fleet of satellites to Earth across the light-years because with their hyper-advanced remote sensing capability they had somehow seen we were preparing nuclear tests and for some strange reason they wanted to observe them from Earth orbit (why not go on using their remote sensing facilities?), after which for some other strange reason they were not interested anymore and left?
but we do test whether known processes explain the data. When they don't, we flag the anomaly and look deeper. That's how progress happens. (And, I'll add, it's what most skeptics say they want: peer-reviewed, scientifically rigorous work on unknowns rather than Discovery-Channel infotainment.)
And I cannot agree with you more. Just,
where should one look deeper? What's more (overwhelmingly) probable, a difficult-to-pin-down instrumentation problem, ie. see
2011 OPERA faster-than-light neutrino anomaly,
perytons (fast radio transients detected at the Parkes Observatory, later tracked down to the opening of a microwave oven nearby), or a constellation of alien satellites with the bizarre characteristics as above?
And hey...if we start seeing repeatable evidence of Palomar telepaths or flying spaghetti that hides stars on plates, I'll happily revisit my priors.
And the same will do I if we start seeing repeatable evidence of visiting aliens (or of psychic powers, for that matter).
