Should You Trust “Science-Based” Healthcare Claims? - Dr. Michael Ruscio, DC

Does your gut need a reset?

Yes, I'm Ready

Do you want to start feeling better?

Yes, Where Do I Start?

Do you want to start feeling better?

Yes, Where Do I Start?

Should You Trust “Science-Based” Healthcare Claims?

A quick guide for healthcare consumers.

If you’ve spent any time on the internet researching healthcare topics, you’ve probably bumped into a number of outrageous product claims and lots of conflicting information. Everyone’s healthcare claim, it seems, is backed by a scientific study.

Sometimes it’s deliberate misinformation, but more often healthcare “experts” don’t take steps to test their personal biases and don’t invest the considerable time needed to fully understand a research topic.

How Marketers Misrepresent the Research

Here are some of different ways that internet marketers misrepresent scientific evidence:

  • They claim a rat or petri dish study is proof that a product works for humans.
  • They cherry pick one or two individual studies that support their claim, and ignore the rest of the research.
  • They jump on bandwagons when an exciting new study is published, without waiting for follow-up research.

As a healthcare consumer, it’s important to educate yourself so that you can spot faulty scientific claims.

Levels of Research Quality

There’s a widely-accepted hierarchy of research quality, as shown in this pyramid diagram.

The difference between these levels of evidence is similar to the way restaurants are reviewed. You could ask one person’s opinion about a restaurant, but they may have been there on a particularly bad night. If you ask a group of friends, you might get a few different opinions. If you look online, you might find hundreds of reviews and now you can see overall trends and an average score. That’s super helpful.

So, with that in mind, let’s have a closer look at each of the four levels of evidence:

  • The highest levels of evidence are summaries of multiple studies. These include:
    • Systematic Reviews – A review of all the available research data on a given topic.
    • Meta-Analyses – A review of all the available research using math to fully analyze the overall results.
  • Human Clinical Trials (also known as randomized control trials) are human studies that test specific health interventions and control for the placebo effect. Human clinical trials are a very high level of research. Very large human clinical trials (with hundreds or thousands of subjects) are considered higher evidence than human clinical trials with fewer subjects.
  • Observational Studies are studies where researchers observe humans but don’t make any health interventions. Observational studies can identify associations. For example, one study found that patients with SIBO had a higher frequency of coronary artery disease. [1] But this doesn’t establish cause and effect. In other words, there’s not enough information to claim that SIBO causes coronary artery disease. There are two types of observational studies:
    • Case Studies observe an individual patient.
    • Cohort Studies observe a group of people.
  • Cell Studies and Animal Studies—Petri dish studies and rat studies are useful starting points in the research process, but they are not evidence for human health claims. Unfortunately, marketers and the media often cite animal and cell studies. This is the source of much confusion surrounding many health care topics.

Scientific research is a slow, step-by-step process of investigating and building a body of evidence. A single study may be interesting or intriguing, but it’s probably not definitive proof of anything. Over time and with additional studies, we can start to extract more meaningful conclusions from the research.

My Standards for Healthcare Claims

In a world where sloppy and misleading use of research is the norm, I’ve developed standards to ensure that we provide you with reliable and trustworthy healthcare information. For example:

  • I rely on and cite the highest level evidence.
  • I don’t just search for references to fit my beliefs. I start with a hypothesis and we search for all evidence that supports and contradicts the hypothesis.
  • When the evidence is limited, I disclose that.
  • I am open minded, yet cautious.
  • I don’t like to jump on research bandwagons. While others hype an “exciting breakthrough product” based on just one study, I prefer to wait for supporting evidence.  When that becomes available, I try out products in my clinical practice for at least 6-8 months before I consider adding them to my product line.

How Poor-Quality Evidence Can Hurt You

I want to illustrate the kind of misinformation that can harm you as you try to make health care decisions.

Unresearched Claims

Digging through the research takes time and expertise. Many internet marketers simply can’t be bothered. So they parrot each other’s statements, until these claims become accepted as “the truth.” For example, many bloggers and marketers claim that probiotics are a bad idea if you have SIBO. Here are two examples:

  • “With SIBO, when you take bifidobacterium probiotics, they jump off the digestive tract train in your small intestine. They can add to the overgrowth that’s already happening, and that means more discomfort for you.” [2]
  • “There is no research-based answer as to whether probiotics for SIBO are helpful. But despite this lack of evidence, the internet is full of self-proclaimed experts advising all manner of probiotic supplement protocols claiming to treat or prevent SIBO. Consider this: If SIBO represent an overgrowth of normal (aka benign or “good”) bacteria in a neighborhood that’s too hospitable to bacteria, isn’t it possible–and even likely–that these supplements are actually “seeding” the recurrence by delivering concentrated doses of bacteria day after day?” [3]

In the first example, no evidence is presented to support the claim that probiotics add to SIBO overgrowth. The second example claims there is no research into probiotics for SIBO.

Both statements are flat-out wrong.

Probiotics (including bifidobacterium) have been CLEARLY shown to be effective in treating SIBO, both for improving symptoms and SIBO lab test values. Consider these studies:

  • A meta-analysis (the highest quality science) summarizing 18 clinical trials concluded that probiotics are an effective treatment for SIBO. [4] The analysis concluded that probiotics reduce bacterial overgrowths and hydrogen concentrations, and improve symptoms, including abdominal pain.
  • A small clinical trial with 25 patients found probiotics to be more effective than the antibiotic metronidazole (a standard treatment for SIBO). [5]
  • Another small clinical trial found that probiotics work substantially better in patients with both IBS and SIBO, as compared to those who have IBS without SIBO. [6]

In this example, unresearched blog claims might have you avoiding a therapy that research shows is likely to help you.

Unresearched Products

Another potentially dangerous practice is marketing of products that simply have no research to support them. For example, most of the strains in this probiotic supplement have no research to support their safety and effectiveness.

With over 500 research studies that support the safety and effectiveness of a wide range of probiotic species, you have to wonder why this company chose to formulate their product this way. Ultimately it’s you, the healthcare consumer that is taking the risk.

Cherry Picking Results

Internet marketers like to cherry-pick data that supports their marketing goals. For example, here is a study that is often cited to sell probiotics for weight loss:

  • Researchers found that subjects who ate yogurt with probiotic strains Lactobacillus fermentum or Lactobacillus amylovorus lost 3-4% body fat over a 6-week period, while a control group lost 1% in the same period. [7]

Sounds good, right?

Except, citing only one clinical trial with 28 participants, while ignoring a large body of higher-quality research is very misleading. In this case, the high-quality data suggests that probiotics are not very helpful for weight loss:

  • A 2019 meta-analysis of 19 clinical trials suggests that probiotic supplements have a small effect on reducing waist circumference but no effect on body weight or BMI. The study also concluded that results are not definitive because the quality of data to date is low to moderate. [8]
  • A 2017 meta-analysis of 15 clinical trials showed that probiotics have small effects on weight loss and no effect on fat mass. [9]
  • A 2017 systematic review evaluated the effects of Lactobacillus on weight loss and/or fat mass in overweight adults. Of 14 studies included in the review, nine showed decreased body weight and/or body fat, three did not find effect and two showed weight gain. [10]
  • A 2015 meta-analysis found no significant effect of probiotics on body weight and BMI. Researchers concluded that the quantity and quality of data available were insufficient to draw definitive conclusions. [11]

Reputable practitioners and marketers will provide you with a full summary of the evidence for their claims.

Bottom Line

It’s my personal goal to give you practical, science-based advice. I hope the information I’ve shared in this article will help you to become a more informed and savvy healthcare consumer.

References (click to expand)
  1. Fialho A, Fialho A, Kochhar G, et al. Association Between Small Intestinal Bacterial Overgrowth by Glucose Breath Test and Coronary Artery Disease. Dig Dis Sci. 2018;63(2):412-421. doi:10.1007/s10620-017-4828-z
  2. The 12 Signs of SIBO (What You Don’t Know Can Make You Sick). (n.d.). https://justthrivehealth.com/blogs/blog/sibo-and-spore-probiotics
  3. Freuman, T. D. (2018, June 21). 4 Facts About SIBO the Internet Keeps Getting Wrong. https://health.usnews.com/health-news/blogs/eat-run/articles/2018-06-21/4-facts-about-sibo-the-internet-keeps-getting-wrong
  4. Zhong C, Qu C, Wang B, Liang S, Zeng B. Probiotics for Preventing and Treating Small Intestinal Bacterial Overgrowth: A Meta-Analysis and Systematic Review of Current Evidence. J Clin Gastroenterol. 2017;51(4):300-311. doi:10.1097/MCG.0000000000000814
  5. Soifer LO, Peralta D, Dima G, Besasso H. Comparative clinical efficacy of a probiotic vs. an antibiotic in the treatment of patients with intestinal bacterial overgrowth and chronic abdominal functional distension: a pilot study. Acta Gastroenterol Latinoam. 2010;40(4):323-327.
  6. Leventogiannis K, Gkolfakis P, Spithakis G, et al. Effect of a Preparation of Four Probiotics on Symptoms of Patients with Irritable Bowel Syndrome: Association with Intestinal Bacterial Overgrowth [published correction appears in Probiotics Antimicrob Proteins. 2018 Mar 28;:]. Probiotics Antimicrob Proteins. 2019;11(2):627-634. doi:10.1007/s12602-018-9401-3
  7. Jaclyn M. Omar, Yen-Ming Chan, Mitchell L. Jones, Satya Prakash, Peter J.H. Jones. Lactobacillus fermentum and Lactobacillus amylovorus as probiotics alter body adiposity and gut microflora in healthy persons. Journal of Functional Foods, Volume 5, Issue 1, 2013, Pages 116-123, ISSN 1756-4646. https://doi.org/10.1016/j.jff.2012.09.001.
  8. Erica A Suzumura, Ângela C Bersch-Ferreira, Camila R Torreglosa, Jacqueline T da Silva, Audrey Y Coqueiro, Marilyn G F Kuntz, Pedro P Chrispim, Bernardete Weber, Alexandre B Cavalcanti, Effects of oral supplementation with probiotics or synbiotics in overweight and obese adults: a systematic review and meta-analyses of randomized trials, Nutrition Reviews, Volume 77, Issue 6, June 2019, Pages 430–450, https://doi.org/10.1093/nutrit/nuz001
  9. Borgeraas, H.Johnson, L. K.Skattebu, J.Hertel, J. K., and Hjelmesæth, J. (2018Effects of probiotics on body weight, body mass index, fat mass and fat percentage in subjects with overweight or obesity: a systematic review and meta‐analysis of randomized controlled trialsObesity Reviews19219– 232. doi: 10.1111/obr.12626.
  10. Crovesy, L., Ostrowski, M., Ferreira, D. et al. Effect of Lactobacillus on body weight and body fat in overweight subjects: a systematic review of randomized controlled clinical trials. Int J Obes 41,1607–1614 (2017). https://doi.org/10.1038/ijo.2017.161
  11. Sunmin Park, Ji-Hyun Bae. Probiotics for weight loss: a systematic review and meta-analysis. Nutrition Research, Volume 35, Issue 7, 2015, Pages 566-575, ISSN 0271-5317. https://doi.org/10.1016/j.nutres.2015.05.008.

Need help or would like to learn more?
View Dr. Ruscio’s, DC additional resources

Get Help

Discussion

I care about answering your questions and sharing my knowledge with you. Leave a comment or connect with me on social media asking any health question you may have and I just might incorporate it into our next listener questions podcast episode just for you!