I was born in June 1989. Just 2 months after that, the Voyager 2 spacecraft flew past Neptune on its way out of our solar system and for the first time ever we saw real close up pictures of the solar system’s outermost giant planet.
Of course, I was too young to remember this, but it means that as I’ve been growing up I’ve been able to see amazing and beautiful photos of the 8 planets of our solar system. Pluto is no longer classified as a planet, but nonetheless it has been conspicuously missing from this set for my whole life.
That is, until this week. After travelling for 9 1/2 years, the New Horizons spacecraft finally flew past the only remaining “classic planet” that we had not yet explored. We are seeing real close up pictures of a new world, one that we’ve never seen like this before. And it’s glorious:
This image is made by compositing the high resolution black and white image taken from LORRI (LOng Range Reconnaissance Imager) and colour imagery taken from Ralph (New Horizons’ colour imager). It was sent back to Earth by New Horizons prior to its exciting flyby of Pluto on Tuesday night (closest approach was 11:50 pm Tuesday 2015/07/14, New Zealand time), having been taken 16 hours ahead of time.
It sent back data ahead of time because during the 24 hour flyby New Horizons was busy collecting data. All of its instrumentation is built into the body of the spacecraft, so in order to point them the whole spacecraft needs to rotate. This means that in order to talk to Earth it has to look away from Pluto, so we had to wait in patient agony while it was collecting data.
After the flyby, New Horizons sent a packet of telemetry data back to Earth, containing information about how its systems were doing. The flyby was the most dangerous part of the mission; travelling at about 14 kilometres per second, an impact with even a tiny piece of debris could absolutely destroy the spacecraft and near Pluto is the most likely place to encounter such debris. Since New Horizons was travelling into the unknown, no one could guarantee this wouldn’t happen, although NASA was confident that the chance of such a collision was very low.
The “Phone Home” signal reached Earth at 12:52:37 pm on Wednesday 2015/07/15 (New Zealand time), telling us that everything went perfectly. New Horizons survived the flyby! The next stage of the mission is to send down all the data it collected, but getting data back from Pluto is hard. Even at the speed of light signals take over 4 hours to cross the distance, and the transfer rate varies from just 1 kb/s to a whopping 4 kb/s. It’ll take around 16 months to get all the data from the flyby down to Earth.
This morning (7am Thursday 2015/07/16 New Zealand time) NASA held a press conference in which they released some new images, including a high resolution image of Pluto’s largest moon Charon:
There’s a lot of interesting stuff going on here, for example that little notch you can see in the upper right is a canyon that’s 6-10 kilometres deep. So deep that you’re looking through it to the space behind Charon. The dark polar region at the top, which has been informally named “Mordor”, is also interesting. The fact that impact craters allow lighter material to peek through makes it seem as though the dark material on the surface is just thin layer. Apparently one possible cause of this could be some form of atmospheric transfer from Pluto.
At the press conference, NASA also released a much higher resolution of an area in the “heart” region of Pluto. The heart has been named Tombaugh Regio after Clyde Tombaugh, who discovered Pluto in 1930. Although he died in 1997, New Horizons carried some of his ashes on board to honour his request for his ashes to be taken to space. Here’s the image:
This is a very interesting image. The first thing you might notice is the mountains. These are about 3.5 kilometres tall, and almost certainly made of water ice. Also, there are no impact craters in this photo. That’s strange, really strange. It means that Pluto’s surface is new, probably less than 100 million years old.
Pluto is the first icy world we’ve seen that isn’t also the moon of a gas giant. Icy moons like Saturn’s moon Enceladus get stretched and heated by the tidal forces placed on them due to their close proximity to much more massive bodies. Tidal forces are caused by a gradient in the strength of gravity – parts of a body closer to a source of gravity experience a stronger force than those further away, and when this gradient is strong (which happens when you’re nearby a much larger body) the tidal forces are greater. The Moon’s tidal influence on Earth drives our oceanic tides, and the extreme tidal forces you’d experience crossing the event horizon of a black hole are what would turn you into a space noodle.
But Pluto isn’t near any other large bodies that could exert this sort of tidal force on it. Charon is around half its size, but Pluto and Charon are both tidally locked to one another, meaning the same parts always face each other, so the tidal forces never change. There must be some other process driving geological activity on Pluto, and we don’t know what that is yet.
This isn’t the end for New Horizons, even after the 16 month period of sending all its data down it’s going to continue into the outer region of the solar system known as the Kuiper belt, and hopefully visit one or two more icy worlds.
For now, though, we have finally completed our reconnaissance of the solar system. This is the end of the beginning.
After my earlier post on this topic, I talked to a few people about why they thought these stretching reflections happened. There were a few different ideas, and when I talked to my brother about it he pointed out something in one of the images on my last post that was inconsistent with my explanation.
My hypothesis would have predicted that reflections would stretch down, but not up. However, looking more carefully at this image, the reflection of the Sun is clearly both stretching down and stretching up to the horizon. So it can’t be explained just by the surface appearing to be rougher as it gets closer to the observer.
However, in that discussion we came up with a new hypothesis. As I said in my last post, if we imagine a rough surface as being made up of a lot of small flat mirrors at random angles, some of them will be at the correct angle to reflect light toward you so you’ll see a reflection in those places. The new hypothesis was that the angle required for this would be less extreme above and below the reflection than to the side of it.
In order to test this, I needed 3 things:
A light source
A flat reflective surface
A flat surface to rest it all on
Luckily, these things were all readily at hand. For a light source, I used a nearby lamp. My phone’s screen made a good flat reflective surface. I used the alarm remote for my car as the wedge, and rested everything on the floor. I’m sure you could find similar objects to reproduce this experiment for yourself.
First, I lined up the lamp, my phone, and myself so that I could see the lamp’s reflection in the centre of my phone’s screen when it was sitting flat on the floor. Then, using my makeshift wedge I tiled the screen of my phone away from me, then moved the tilted reflective surface towards me until the lamps’ reflection was in the middle of the screen.
I then repeated this for the other directions – away from me, to the left, and to the right. Because my phone isn’t square, I also rotated it so it was landscape when I moved it towards me and away from me, but portrait when moving it left and right. That made it easier to judge when the reflection was in the centre of its screen.
What I found was that I had to move the phone a lot further toward me or away from me than I had to move it left or right in order to see the reflection again. I think this explains, at least in part, why reflections on rough surfaces appear to be stretched towards you.
We can get a rough approximation of the outline of a reflection on a rough surface by assuming it has a maximum roughness, i.e. the maximum angle at which one of those little mirrors that make up its rough surface could be tilted. Then, the approximate outline of the reflection would be along the curve where a mirror at that maximum angle, facing in the right direction, would reflect light toward you.
On a perfectly flat surface, this maximum angle is 0. So the shape of the reflection is exactly as you’d expect, undistorted.
However, as the maximum roughness of the surface increases, the outline moves out from the undistorted reflection. And the reflection doesn’t just get larger, it gets stretched towards you. It’s because the angle required to reflect it at you is less within that outline that reflections on rough surfaces appear to be stretched.
The simulation works by sending out rays from the observer to hit different parts of a horizontal reflective surface. When a ray hits the surface, the simulation calculates the angle that would be required at that point to cause the simulation’s light source (displayed as a red dot) to be reflected there. Places where there would be a reflection are shaded according to the required angle, with brighter yellow areas being flatter, and areas where there would be no reflection are black. The simulation also draws a reflected red dot to show where the reflection would be on a very flat surface.
There are a few numbers you can configure to see how the shape of the shadow changes under various scenarios:
Light source distance
The distance “into the screen” that the light source (the red dot) is from you.
Light source height
How much higher than you the light source is. You’ll want to make sure it’s higher than the reflector.
How much lower (using negative numbers) the reflective surface is than you. The simulation doesn’t look above horizontal for reflections, so this won’t work with positive numbers.
The maximum amount of roughness the reflective surface can have. Higher numbers are rougher, lower numbers are flatter.
How far apart the rays are, in degrees. The default setting is 0.1 degrees. Larger step sizes will make the simulation run faster, but it will be less precise.
The simulation shows how reflections can be stretched vertically in this way, depending on the roughness of the reflecting surface and the relative positions of the observer and the light source. If you make the light source very far away and near the horizon, you’ll see that the reflection can stretch all the way up to the horizon just like the Sun’s reflection in that picture.
However, there’s still a decent amount of horizontal spreading so I don’t think this entirely explains the stretched reflections. Yesterday, I saw this beautiful photo on Twitter, taken by Ian Griffin of a sunset in Otago:
In this photo, there is pretty much no horizontal stretching. This can be seen in the black lines in the reflection caused by trees blocking the Sun’s light – if the reflection were stretching sideways then these would be blurred and wouldn’t have such a uniform thickness.
There could be a few things helping in this case. Because this particular example is taken with water being the reflective surface, and the observer was standing at the shore, the waves are mostly perpendicular to the line of sight. That would help minimise horizontal scattering.
It can’t be just that, though, because the same stretching is seen on rough surfaces where the roughness has no direction, such as wet roads:
I think the rest of this could possibly be explained by surfaces that reflect the light straight towards you from under the light source appearing larger, because they’re angled towards you. Surfaces to either side of the reflection could also reflect the light towards you, but perspective would cause them to be foreshortened and therefore contribute less to the overall picture.
On a rough reflective surface like the ocean or a dark wet road, reflections from bright lights like city lights, car brake lights, or the Moon appear stretched vertically. Why is this?
When a surface is perfectly flat, like a regular mirror, the image we see in the reflection isn’t distorted at all. Even if we put a mirror flat on the ground, we wouldn’t see a vertically stretched reflection like this.
Neither the road nor the ocean are perfectly flat though. Their surfaces are rough, and this rough surface scatters light when it’s reflected. If we imagine that each piece of the surface was a little flat mirror, with each piece facing in a random direction, some of these would be at the right angle to reflect light from a source (like the Sun) directly into our eyes, and most would not. We’d only see a reflection in those pieces that are at the correct angle to reflect the light into our eyes.
The further these little mirrors are from the area where we’d see the reflection in a flat mirror, the more extreme an angle they will need in order to still reflect the light at us. If every one of these little surfaces was really really tiny, what we’d expect to see is a blurry reflection. The smaller the pieces get, the less blurry the reflection would get.
We can actually see this in effect when we compare pictures of the Sun reflected off the ocean. When you’re quite near the ocean, all the different reflecting surfaces are relatively large so the reflection is quite blurry and broken (especially if there are lots of waves):
In comparison, if we look at a reflection of the Sun on the ocean that was taken from space, all the waves and ripples that distort the reflection are far too tiny to see, and as a result the reflection is quite clear and crisp:
Another difference that’s quite apparent between these photos is the vertical stretching that I’ve been wondering about. From up close, it’s very stretched. From a distance? Not so much. This gives me a thought, one that actually hadn’t occurred to me until I got to this point in writing this post and saw those images one after another:
What if it’s important that there’s a significant relative distance between the closest and furthest parts of the surface that are reflecting the light source?
From a long way away, these distances appear quite small. For example, if I’m 1 km away from a surface, then a 1 m distance between two points on that surface is really quite small. If I’m only a metre away myself though, then that’s a very significant distance.
As we just saw, reflections on non-flat surfaces are more blurry when they’re closer to you, so what if this vertical stretching is actually just the reflection getting more blurry towards the bottom, because that part of the road or ocean is closer? As it’s more blurry, this would let the edge of the reflection creep out further, and could look like stretching.
If I’m right, then I should be able to see the same type of stretching if I look at a reflection on a vertical surface, except the stretching would be horizontal in that case. I should also be able to replicate the same stretching effect if I can get a reflecting surface that is smooth on top and gets rougher towards the bottom, and look at a reflection of a light in it like I would a normal mirror (i.e. with the reflecting surface vertical and the light source behind me).
Let me know what you think of this idea in the comments, and if you have any ideas of your own for why we see these stretched reflections. Any ideas about how I could try to disprove my idea would be welcome too! In the meantime, I’ll try to do these experiments, and see if I can find an expert to talk to about this question.
On the second Wednesday of every month, there’s a great Twitter chat on science communication in New Zealand: #SciCommNZ
Unfortunately I’m always busy on Wednesday evenings while this is going on, but I’ve tried to participate as much as I can by joining in late and reading through each discussion. The questions that have been asked have made me think about the things I write about on this blog, and some of the things I’d like to write about:
After having these thoughts churn around in my head for a few weeks, I’ve come up with something I’d like to try.
There are a lot of “everyday science” questions that I see asked and answered fairly often. Common examples include “why is the sky blue?” (which is not quite as simple as you might think) and “how do rainbows work?”. I really like these questions, but I feel sometimes like they’ve all been done many times already.
Of course, they haven’t all been done many times already. But I do feel like I see the same “everyday science” questions over and over again. I think they’re great and really interesting the first time you encounter them, so I want more.
As a remedy to this, and as an attempt to do something different and (hopefully) interesting with my science communication, I’m going to start asking some of my own everyday science questions. This might be a bit grandiose, but I’m calling this little project of mine Natural Curiousity
The format may change as I get into it, but the way I see this happening is to take every question in two parts:
First, I’ll write a post framing the question and some of my own thoughts (as a non-scientist) on what the potential answers might be, and what some problems with those potential answers might be. I want to try to do this without any Googling, but I might try a few homemade experiments. My hope would be that posts like these could get some interesting discussion going, but I guess we’ll see.
After that, I’d like to talk with someone who is an expert in a relevant topic and get their thoughts on the question, both on the potential answers brought up in the first post and on what they think the answer probably is and why. This isn’t something I’ve done before, so I hope I’ll be able to find some experts who’ll be happy to find some time to talk to me about this.
If you have any everyday science questions that you’ve been wondering about, let me know in the comments. I’ll update this post with links to posts using this format as I publish them.
When reading a story about someone who has been scammed, it’s very easy to think ‘that could never happen to me’. From the outside, warning signs always appear obvious and the conclusion often seems untenable. It’s easy to assume that people who fall for scams or are otherwise misled must be unintelligent or gullible. The reality is less comfortable. We can all be fooled, even the best of us.
One historical example of someone very intelligent falling for what now seems to be clearly false, involves author and doctor Sir Arthur Conan Doyle, creator of Sherlock Holmes. Despite obviously understanding the principles of scepticism, Doyle became convinced in the early 20th century that fairies were real, based on a series of photographs of the “Cottingley Fairies”, which were revealed decades later to have been faked using paper cut-outs. Intelligence is no failsafe against being fooled.
More recently, many people, including Shaquille O’Neil and Bill Clinton, have been fooled by a plastic wristband: the makers of which claim it can improve a person’s strength and balance.
The ‘theory’ behind the tests used to promote these wristbands is also employed by various alternative health practitioners in attempts to evaluate treatment effects and to diagnose illnesses, allergies, and intolerances, despite the fact that there is no scientific proof behind it.
It’s known as ‘applied kinesiology’ and, if you don’t know any better, it can be very convincing.
Ethical pharmacy practice is something I have writtenabout before. If you’ve read those posts, please bear with me as I cover some familiar background.
In New Zealand, we are lucky enough to have an industry code of ethics for pharmacists, published by the Pharmacy Council of New Zealand, which holds pharmacists to high ethical standards. This code of ethics is the Safe Effective Pharmacy Practice Code of Ethics. One of the most important parts of this code of ethics is section 6.9, which states:
[PHARMACISTS] MUST:… Only purchase, supply or promote any medicine, complementary therapy, herbal remedy or other healthcare product where there is no reason to doubt its quality or safety and when there is credible evidence of efficacy.
Pharmacy Council’s Safe Effective Pharmacy Practice Code of Ethics Section 6.9
The Pharmacy Council of New Zealand isn’t a voluntary member organisation like the Pharmacy Guild or the Pharmaceutical Society. Instead the council is established as part of the Health Practitioners Competence Assurance Act 2003. Their roles are set out in this act and include:
Reviewing and maintaining the competence of pharmacists
Setting standards of clinical competence, cultural competence, and ethical conduct for pharmacists
Which means that the Safe Effective Pharmacy Practice Code of Ethics is not a voluntary code of ethics. It is published by the body whose legal duty it is to set the standards of ethical conduct for pharmacists. Yet all over New Zealand, many pharmacists ignore it.
Walk into any New Zealand pharmacy. Chances are that you will find a section where they advertise and sell a range of homeopathic products. To anyone familiar with the evidence for homeopathy, it will come as no surprise when I tell you that there is no credible evidence of efficacy for any homeopathic product. Therefore, it seems to me, New Zealand pharmacists have an ethical obligation not to promote or sell them.
Yesterday, the Australian National Health and Medical Research Council (NHMRC) issued their final statement on homeopathy, following an incredibly extensive and rigorous review of the literature. They looked at over 1,800 scientific papers, and found that 225 met their criteria for methodological rigour, sample size, and placebo control. Their main finding was:
there are no health conditions for which there is reliable evidence that homeopathy is effective.
As I said, this conclusion does not come as a surprise. This research is the latest in a long line of reviews of the evidence for homeopathy that drew essentially the same finding:
A 2002 systematic review of systematic reviews of homeopathy published in the British Journal of Clinical Pharmacology concluded that:
the hypothesis that any given homeopathic remedy leads to clinical effects that are relevantly different from placebo or superior to other control interventions for any medical condition, is not supported by evidence from systematic reviews. Until more compelling results are available, homeopathy cannot be viewed as an evidence-based form of therapy.
In 2013, the NHMRC published a report based on their research that found:
There is a paucity of good-quality studies of sufficient size that examine the effectiveness of homeopathy as a treatment for any clinical condition in humans. The available evidence is not compelling and fails to demonstrate that homeopathy is an effective treatment for any of the reported clinical conditions in humans.
I could go on, but I hope by now you get the idea.
New Zealand pharmacists need to respond to the NHMRC’s research. And if they mean to practice responsibly and ethically, that response should be to immediately stop all promotion and sale of homeopathic products. The ethical standard to which they should be held is clear, and it is not consistent with promoting or supplying homeopathic products.
Last year, I complained to the Advertising Standards Authority under the auspices of the Society for Science Based Healthcare about a homeopathic product for preventing jet lag (No-Jet-Lag) that was advertised in Parnell Pharmacy. The pharmacy responded by removing the advertisement, and agreeing to stop selling the product if it was found that the claims were not supported by credible evidence, and my complaint was upheld. Unsurprisingly, my complaint was upheld when the ASA decided claims such as “it really works” were not supported by credible evidence. However, despite Parnell Pharmacy’s example, many New Zealand pharmacies still sell this exact product.
The NHMRC’s report represents the same finding, but on a larger scale. New Zealand pharmacists who promote and sell homeopathic products should follow the responsible example of Parnell Pharmacy, and remove homeopathic products from their shelves.
Recently I’ve run across a couple of New Zealand companies that sell therapeutic products – one a weight loss pill, the other a jet lag drink – that seem to put marketing first and let science take the back seat. This is by no means new behaviour, but I want to use them as examples to illustrate this widespread problem and suggest what can be done to combat it.
Before promoting a therapeutic product, you should first have good reason to believe that it works. This, I hope, is common sense, but it’s also enshrined in the Fair Trading Act and the Therapeutic Products Advertising Code as they prohibit unsubstantiated claims. This means you have to test the product, and do so rigorously. Rigorous clinical trials are expensive to undertake though, so they’re quite a prohibitive first step.
Instead of jumping straight into the deep end, a useful first step can be to undertake a smaller and less rigorous (and therefore less expensive) experiment. In order to answer the question of whether or not a product actually works you need to conduct a more rigorous trial. There’s a great cost involved in doing this, but if the results of a preliminary trial are optimistic then you have reason to expect a more rigorous trial might give similar results, so the expense might be worth it. You may even be able to get some funding to help with a more rigorous trial on the basis that the preliminary results were positive.
As you can see on the trial registration page, this was an uncontrolled trial on overweight adults. The original plan was to recruit 100 volunteers with the hope that at least 60 will complete the trial. I have to say I’m a bit confused about how many people were in the trial, as apparently the recruitment was increased to 200 applicants after applications opened (a change that has not been reflected in the trial’s registration) yet apparently about 400 people applied. One article claims there were 200 participants, a later media release from Tuatara Natural Products seems to imply 100 were recruited, and the analysis of the trial says there were only 81 participants. Either way, 81 participants completed the full 8 weeks, and 52 of them took the recommended dose for the whole duration of the trial.
If there were 19 or 119 participants who didn’t complete the trial, the statistical analysis seems to ignore them with no justification given. This is unusual – a 19% drop out rate is significant and shouldn’t be swept under the rug. A lot of the time Tuatara also seems to ignore the 29 participants who didn’t drop out but also didn’t take the full dose for the whole duration.
The Science Media Centre posted the responses of 2 experts, Associate Professor Andrew Jull and Professor Thomas Lumley, to a press release from Tuatara Natural Products in February. It’s a good analysis of some of the weaknesses with the study, and I recommend you read it: Kiwi diet pill claims – experts respond
This trial was uncontrolled, and therefore also unblinded and unrandomised. As Professor Lumley explains, this is a problem if you want to draw strong conclusions from its results. It is of low methodological quality, but that’s okay. There is no problem with doing less rigorous trials first if they’re done in order to determine if more rigorous trials are necessary. Dr Glenn Vile, Chief Technical Officer of Tuatara Natural Products and the principal investigator for this study, wrote the following in a comment on a post on the “Fat Mates” trial by Dr John Pickering:
The Fat Mates trial was designed by clinical trial specialists to generate information about the Satisfax® capsules that would help Tuatara Natural Products plan a larger and longer double blind, cross over, placebo controlled trial.
We will use this information to proceed with the next clinical trial, but in the meantime we were so excited the weight loss achieved by most of our Fat Mates was much greater than the placebo effect seen in other weight loss clinical trials that we decided to launch the product so that anybody who is overweight can try Satisfax® for themselves.
I think the first part of what I’ve quoted above describes exactly what Tuatara Natural Products should be doing. They’ve conducted their low quality trial, and intend to use its results to proceed with a larger, longer, and more rigorous clinical trial. This is the right way to proceed – they now have an indication that their product might be effective, so they should do the research to find out.
The problem is that that’s not all they’re doing. After performing only a small low-quality trial, they’ve released their product for sale online and have been making a lot of noise about it. In my opinion, they’ve been significantly overstepping the results of their clinical trial. For example, in his comment Dr Vile also said:
our initial trial has shown [Satisfax] to be extremely effective in some overweight people.
Dr Glenn Vile
In their media release on the 20th of February, they reported the average weight lost only by the 52 participants who took the full dose to completion (rounded up from 2.9 kg to “close to 3kg”) but not the average weight lost by all participants. They then reported in bold that the top 26 participants lost more weight, and the top two participants lost even more weight than that!
This cherry picking of the best results appears to have been part of Tuatara Natural Products’ marketing strategy for at least a few months now. In January, Stuff published an article on the trial highlighting the single person who lost the most while participating in it: Blenheim ‘fat mate’ loses 13.5kg in 8 weeks.
That article particularly highlights the person who lost the most weight out of all those in the trial, at 13.5 kg (confusingly, the maximum weight loss reported in the analysis of the trial’s results is 13.3 kg). However, she was one of only 2 participants who lost over 10 kg, and on average the 52 participants who took the recommended dose for the full eight weeks lost 2.9 kg. Losing 13.5 kg is very far from a representative example. I’m not surprised that they didn’t choose instead to focus on the participant who gained 1.2 kg despite taking the recommended dose for the whole duration, but that is actually much closer to the mean change in weight.
The article is, for all intents and purposes, one big testimonial in favour of Satisfax. It was an article, not an advertisement, which is important because in New Zealand it’s illegal to publish any medical advertisement that:
directly or by implication claims, indicates, or suggests that a medicine of the description, or a medical device of the kind, or the method of treatment, advertised… has beneficially affected the health of a particular person or class of persons, whether named or unnamed, and whether real or fictitious, referred to in the advertisement
This effectively bans all health testimonials from advertisements. I think this is a good part of the law, as testimonials can be both very convincing and completely misleading; a quack’s dream. Banning them should force businesses to instead focus on the results of research on their products, but this hasn’t stopped Tuatara Natural Products from getting stories written about the most extreme testimonials they could find from people who have lost weight at the same time as they were taking Satisfax.
More recently, Tuatara Natural Products has put out a press release multiple times (at least on the 20th of February and again on the 4th of March) that I think rather oversteps the results of their small preliminary trial:
A NEW ZEALAND SOLUTION TO A GLOBAL PROBLEM A little pill is providing an exciting answer to one of the worlds greatest and fastest growing problems: Obesity.A NEW ZEALAND SOLUTION TO A GLOBAL PROBLEM
A little pill is providing an exciting answer to one of the world’s greatest and fastest growing problems: Obesity.
I simply don’t think they are at all justified in saying that their new product is “providing an exciting answer to… Obesity”. They are putting marketing ahead of science, and that’s not okay.
Another company that seems to put marketing before research is 1Above. They make a drink which they claim can help you recover faster from jet lag, and have recently been in the news for signing a sponsorship deal with the fantastically successful golfer Lydia Ko.
At the end of that article about their sponsorship deal the reporter, Richard Meadows, made some comments regarding the science behind jet lag relief products and asked some good questions of 1Above’s CEO, Stephen Smith (emphasis mine):
[1Above’s] product contains a mixture of vitamins B and C, electrolytes, and Pycnogenol, a pine bark extract.
The efficacy of flight drinks to combat the effects of jetlag is unproven.
Late last year pharmacists were warned after the Advertising Standards Authority upheld a complaint against an ad saying a homeopathic anti-jet lag pill really worked.
[1Above CEO Stephen] Smith said 1Above would not be doing clinical trials, which were highly expensive and not necessary.
“What we tend to use is testimonials from people who have used the product and swear by it.”
Smith said the key ingredient, Pycnogenol, had itself had been tested in dozens of trials, including its effects on reducing jetlag.
Yes, you read that correctly. The CEO of 1Above literally said that they won’t be doing clinical trials because they are “not necessary” and that they use testimonials instead.
As I said before, using testimonials to promote a therapeutic product, like a drink to help you recover faster from jet lag, can be both very convincing and completely misleading. There’s a reason why testimonials implying health benefits are illegal in New Zealand, and I hope that 1Above’s marketing will not violate this regulation.
Not all testimonials are prohibited, of course. It’s entirely acceptably to provide a testimonial from someone who thinks their drink tastes great, or that they provide great service. Basically anything for which a single person’s experience can provide a useful insight. Therapeutic effects, almost without exception, do not fall into this category, which is a big part of why we need to do clinical trials in the first place. If they quote someone in saying that their product helped them recover faster from jet lag, they may be in danger of breaching the Medicines Act.
For example, I’d expect they probably shouldn’t use a testimonial that says this:
On their website, 1Above currently does refer to research on one of the ingredients in their product, “pycnogenol”. Professor Lumley recently wrote a post about this on his other blog, Biased and Inefficient, regarding these studies and how they are used by 1Above: Clinically Proven Ingredients
I recently contacted 1Above to ask about some discrepancies I found between the abstract of the study they cited for showing pycnogenol reduced the duration of jet lag and their description of it on their website:
I was interested to see the claim your company made that Pycnogenol® has been shown to support circulation and reduce the length and severity of jet lag.
The participants in the study took 50 mg Pycnogenol 3 times per day, but I haven’t been able to find out how much is contained in your products. Is this information available anywhere on your website? I notice the study also says the participants took this regimen for 7 days, starting 2 days prior to departure. Is this comparable with how your product is intended to be used?
I also noticed some differences between the description of the study and its results between the abstract and your website, I would be grateful if you could explain to me the source of these differences.
The abstract states the control group took, on average, 39.3 hours to recover and the experimental group took, on average, 18.2 hours to recover. However your website reports these as 40 and 17 hours respectively.
Also, your website states that the study involved 133 passengers (it’s not clear from the description on your website if they all took Pycnogenol or if some of them were in the control group) who reported the time it took them to recover from jetlag. However, the study’s abstract states that in the first experiment, which is the only one that involved the reporting of the time taken to recover from jetlag, only involved 68 participants – 30 in the control group and 38 in the experimental group.
I would be grateful if you could explain these differences to me, and if you could send me any other relevant scientific information that supports this claim.
To their credit, since receiving my message they did update their website to fix the discrepancies in the reported number of participants and times taken to recover from jet lag, and their CEO replied to thank me for pointing these discrepancies out.
However, they didn’t respond to my other questions about the amount of pycnogenol in their products or the study involving the participants taking pycnogenol for 7 consecutive days, starting 2 days before their flight, which is inconsistent with how 1Above recommends their products be used.
This is just one more company basing their marketing on preliminary trials instead of using them as the basis for research that could actually answer the question of whether or not a product is useful. Worse than Tuatara Natural Products, they even go so far as to consider clinical trials “not necessary” and apparently intend to rely on testimonials instead. It would be much more appropriate for them to spend some of their $2.4 million annualised income on researching their product rather than paying for a sporting celebrity to endorse them.
I try to make my rants constructive, so I want to end this article with the question “What can we do about this?”. If you have any suggestions, I’d love to hear them in the comments section.
I think the most important thing that anyone can do to address this problem is to ask for evidence. If you see a claim made about a product that you think you might buy, then get in touch with the company selling it to let them know you’re considering buying it and to ask for evidence. If they don’t have a good enough answer, then let them know that’s why you won’t be buying their product. If they give you evidence to back up their claim, then great!
Asking for evidence doesn’t have to be a big deal, involving a formal letter or anything like that. When you see a weight loss product advertised on a one day deal site, a copper bracelet that apparently offers pain relief advertised on a store counter, or a jet lag cure promoted on Twitter, make your first response be to politely ask for evidence.
This isn’t a problem that’s going away any time soon. As consumers, we deserve to be able to make informed decisions about the products we buy, and when companies put marketing before research it becomes harder to make these informed choices. But if we work together then we can encourage companies like Tuatara Natural Products and 1Above to improve their behaviour and attitudes toward marketing and research.
Let’s turn “what’s the evidence?” into a frequently asked question for all companies that sell therapeutic products.