Skip to main content

Replication and big toys

A simulation of a Higgs discovery. Allegedly.
The recent kerfuffle about faster-than-light neutrinos has stirred an old concern in my mind. One of the essentials of good science is being able to replicate the results. Any particular experimental setup can always mislead those using it because they get something wrong that they don't realize. This is why the neutrino guys have asked other experimenters to try to confirm what they have found.

A classic lesson in the dangers of relying on a single experimental setup is the one that emerges from the work of Martin Fleischmann and Stanley Pons. They were the people behind the cold fusion debacle in 1989. This was, as far as I can tell, a serious experiment by good scientists. They got some amazing results from their single experimental setup then did something stupid. Instead of attempting to publish in a journal and get peer review, they went straight to the press.

There are two reasons this was stupid. It was partly because it missed the opportunity for critical suggestions from reviewers. And it was partly because the science community hates a show-off and is always suspicious of going directly to the press. It meant that the rest of the community was much heavier on the pair, who had a perfectly legitimate idea that turned out not to be particularly good, than they otherwise would be. Most ideas in science fall by the wayside. There's no problem with this, if you go about it the right way. But once other labs tried to duplicate cold fusion and got nothing, the suspicions started to rise and Pons & Fleischmann were torn to pieces. (Not literally. Scientists aren't that bad. Not quite.)

But here's the concern I have. Just imagine the LHC gang announce that they've found the Higgs boson. Whoops and hurrahs all round. But who is going to duplicate this result? If theirs is the only toy big enough to do the job, who can say that this isn't another cold fusion? Of course they'll check it and do all they can to ring the changes - but the fact is it's the same experimental setup with the same people, and that always carries a risk. I don't want to rain on anyone's parade - but I do think particle physicists need to be really careful about exactly what they announce when their experiments can't be duplicated.

Image from Wikipedia

Comments

Popular posts from this blog

Why I hate opera

If I'm honest, the title of this post is an exaggeration to make a point. I don't really hate opera. There are a couple of operas - notably Monteverdi's Incoranazione di Poppea and Purcell's Dido & Aeneas - that I quite like. But what I do find truly sickening is the reverence with which opera is treated, as if it were some particularly great art form. Nowhere was this more obvious than in ITV's recent gut-wrenchingly awful series Pop Star to Opera Star , where the likes of Alan Tichmarsh treated the real opera singers as if they were fragile pieces on Antiques Roadshow, and the music as if it were a gift of the gods. In my opinion - and I know not everyone agrees - opera is: Mediocre music Melodramatic plots Amateurishly hammy acting A forced and unpleasant singing style Ridiculously over-supported by public funds I won't even bother to go into any detail on the plots and the acting - this is just self-evident. But the other aspects need some ex

Is 5x3 the same as 3x5?

The Internet has gone mildly bonkers over a child in America who was marked down in a test because when asked to work out 5x3 by repeated addition he/she used 5+5+5 instead of 3+3+3+3+3. Those who support the teacher say that 5x3 means 'five lots of 3' where the complainants say that 'times' is commutative (reversible) so the distinction is meaningless as 5x3 and 3x5 are indistinguishable. It's certainly true that not all mathematical operations are commutative. I think we are all comfortable that 5-3 is not the same as 3-5.  However. This not true of multiplication (of numbers). And so if there is to be any distinction, it has to be in the use of English to interpret the 'x' sign. Unfortunately, even here there is no logical way of coming up with a definitive answer. I suspect most primary school teachers would expands 'times' as 'lots of' as mentioned above. So we get 5 x 3 as '5 lots of 3'. Unfortunately that only wor

Which idiot came up with percentage-based gradient signs

Rant warning: the contents of this post could sound like something produced by UKIP. I wish to make it clear that I do not in any way support or endorse that political party. In fact it gives me the creeps. Once upon a time, the signs for a steep hill on British roads displayed the gradient in a simple, easy-to-understand form. If the hill went up, say, one yard for every three yards forward it said '1 in 3'. Then some bureaucrat came along and decided that it would be a good idea to state the slope as a percentage. So now the sign for (say) a 1 in 10 slope says 10% (I think). That 'I think' is because the percentage-based slope is so unnatural. There are two ways we conventionally measure slopes. Either on X/Y coordiates (as in 1 in 4) or using degrees - say at a 15° angle. We don't measure them in percentages. It's easy to visualize a 1 in 3 slope, or a 30 degree angle. Much less obvious what a 33.333 recurring percent slope is. And what's a 100% slope