დასაწყისი · კატალოგი · პროფილი · ცხრილი
აზროვნება BODY HANDBOOK
აზროვნება · §677
Evaluating Online Health Claims
Most of the health content in your feed is built to be shared, not to be true. Across systematic reviews covering dozens of studies and platforms — vaccines, diet, chronic disease, mental health — large fractions of the most-viewed posts are misleading by expert review Suarez-Lledo & Alvarez-Galvez 2021. The skill is recognising the shape on sight: who profits, what was actually measured, what the cited paper actually said. Thirty seconds of careful reading per claim worth acting on — and the supplements you wouldn't have needed stop ending up in your cart, the symptoms you don't have stop describing you, the next ten years of wellness churn stop being the years you live.
Do · As-needed Evidence Emerging თავი აზროვნება

No new behaviour to start, no purchase, no protocol — just a filter you run before any of those. The payoff is what stops happening: the four supplements you don't buy this year, the cyberchondria spiral that doesn't open at 11pm, the influencer you stop trusting before they cost you more than the last one did. The catch is that the work is invisible — nothing dopaminergic about not being scammed. The skill ports out of health into every other claim domain you live inside.

A health post that goes viral isn't being rewarded for being right. It's being rewarded for being shared, and the things that get shared are confident, novel, and emotionally charged — calibrated uncertainty performs badly in every engagement metric the platform has. One large MIT study tracked ~126,000 stories across Twitter and found false stories reached people roughly six times faster than true ones, and went further, deeper, and wider into the network Vosoughi et al. 2018. Health content sits inside that selection pressure. By the time a claim is in your feed, it has already been filtered for what the algorithm wants, which is rarely what you want.

Stack three more forces on top. A face you've watched for ten hours feels like a friend, and a friend's claim gets believed without the work — that's parasocial trust doing the lifting, transferring credibility into a domain the person was never trained in. Production polish — clean white-coat backdrop, lab-shot B-roll, a Latinate term every sentence — reads as scientific without carrying any actual scientific weight. And the default state of scrolling is sharing without evaluating: when readers are simply prompted to consider whether a headline is accurate before they share, sharing of misinformation drops Pennycook et al. 2021. Almost everyone has the equipment to spot bad claims. They just rarely turn it on.

How widespread the bad stuff is

This isn't a hunch about a few bad apples. Two large systematic reviews — one of 69 studies, one of 57 — both reach the same headline: across vaccines, diet and eating disorders, drugs, infectious disease, and chronic conditions, a substantial fraction of the most-viewed social-media health content is classified as misleading when experts in the relevant field grade it Suarez-Lledo & Alvarez-Galvez 2021 Wang et al. 2019. Topic-specific assays sharpen the picture.

The problem also starts upstream of the influencer. Sumner et al. examined 462 academic press releases and the 668 news stories that came from them and found exaggeration in the news tracked exaggeration in the press release rather than the underlying paper — a large fraction of what readers call "media misinformation" was already there when the university communications office wrote the press release Sumner et al. 2014. The post in your feed is the third or fourth hop in a chain that has been getting louder at every step.

On whether reading more carefully helps: small RCTs say yes, modestly and reliably. Roozenbeek et al. ran 90-second "inoculation" videos that teach common manipulation techniques rather than debunk specific claims; across roughly 30,000 participants — including a field test on YouTube — viewers got measurably better at spotting manipulated content Roozenbeek et al. 2022. Pennycook et al.'s accuracy-prompt RCT found that a brief nudge to consider whether a headline is accurate cut subsequent misinformation sharing Pennycook et al. 2021. The effect sizes are not transformative — call it a tenth to a fifth of a step in discernment — but they're real, they replicate, and they come from interventions that take less than two minutes.

The four moves

The whole protocol is four questions you ask of any health claim before you act on it. Each takes about thirty seconds. Don't apply this to every post — that's exhausting and unnecessary. Apply it to anything that would cost you money, time, or risk: a supplement you're about to buy, a protocol you're about to start, a diagnosis you're starting to believe describes you.

1. Follow the citation

If a claim mentions a study, the claim has to actually match the study. Not the topic of the study — the population, the dose, the endpoint, and the effect size. The usual failure is stretch: an in-vitro result in cells becomes "X reverses Y in humans," a six-week trial in twenty subjects becomes "X causes Y long-term," a 15% effect becomes "dramatic," a result in one demographic becomes a universal claim. Pull up the actual paper (the title is usually enough for a PubMed or Google Scholar search). If you can't find it, that's the answer. If you can find it but it doesn't say what the post said, that's also the answer.

2. Map the money

Who profits if you act on this? Sometimes the answer is on the post — a link in bio, a code, a "use INFLUENCER20." Often it isn't, because disclosure rules get routinely ignored despite the FTC requiring sponsored content to be marked FTC 2023. Look at the broader pattern: does the person have a supplement line, a clinic, a course, an affiliate relationship, an ambassador role? Are they pushing a product the maker also sponsored their trip with? None of this makes them wrong. It changes how much you discount.

This matters because money bends what gets reported. A Cochrane methodology review pooled 75 studies on the question and found industry-sponsored trials report more favourable efficacy and conclusions than non-industry-sponsored trials, with relative risk around 1.27 for favourable conclusions — large enough to flip what the headline of a trial says Lundh et al. 2017. DeJong et al. showed that doctors who received a single industry-sponsored meal worth under twenty dollars prescribed the sponsor's brand at measurably higher rates DeJong et al. 2016. If a sandwich moves a physician's prescription, an affiliate deal moves an influencer's recommendation.

3. Treat before/after as marketing, not measurement

A before-and-after photo is not a controlled comparison. Lighting, camera angle, posture, water retention, hydration, tan, makeup, hair, time of day, and the crop of the frame all move the image more than most interventions do over the time scale a wellness post claims. The photographer chose which photo to show. The two photos were not taken under the same conditions. If they had been — same room, same camera, same time, same pose — the post would say so, because that's the harder claim to fake.

The same logic applies to anecdote chains: "this changed my life" from a person who is selling the thing is a sales pitch, not evidence. It can be a true sales pitch (the person sincerely felt better) and still not be evidence — placebo, regression to the mean, concurrent behaviour change, and selection bias all produce the same testimonial.

4. Ask who isn't selling this

The asymmetric signal in health is who recommends something when they have nothing to gain. Independent guidelines bodies — USPSTF, AASM, AHA/ACC, NICE — and Cochrane reviews are the closest thing to a no-skin-in-the-game lane. They publish, they have no products. If the claim is real and important, it usually shows up there eventually. If a claim has been in social media for years and the independent bodies have not picked it up, that's information — sometimes the bodies are slow, but more often the claim didn't survive the evidence. Goldacre's wider critique of how commercial pressures bend formal medicine is a useful reminder that this signal is asymmetric, not absolute — even institutional sources warrant the same questions, just at a different baseline Goldacre 2012.

What still trips smart readers

"It's peer-reviewed, so it's true." Peer review is a filter against the worst methodological failures, not a guarantee that a finding will hold up. Ioannidis's PLoS Medicine paper modelled why the majority of published findings likely fail to replicate — small sample sizes, flexible analysis choices, publication bias against null results, and the prior probability of the hypothesis itself all conspire Ioannidis 2005. A single peer-reviewed paper is a starting signal, not a conclusion.

"They cited a study, so the claim is sourced." A citation is a pointer, not a verification. The chain from claim to citation to original paper breaks at the first hop more often than most readers expect — the citation is real, but it does not say what the post says it says. The whole point of move #1 is that checking the cite is the work; the cite being present is the table stakes, not the proof.

"FDA-approved means safe." For prescription drugs and medical devices, the FDA does pre-market review (with its own well-documented incentive pressures Lurie et al. 2022). For dietary supplements, it largely doesn't — the Dietary Supplement Health and Education Act of 1994 carved supplements out of pre-market efficacy and safety review, leaving the FDA mostly in a reactive role after products are already on shelves Cohen 2014. Geller et al. estimated about 23,000 US emergency-department visits per year are attributable to supplement adverse events Geller et al. 2015. "It's a supplement, so it's safe" is the inverse of true.

"Credentialed expert, so correct." Credentials protect against grosser failure modes — they don't immunise against incentive capture or scope creep. A real MD or PhD earned in one domain can be transferred to a different domain where the person has no training but full social licence, and the same person inside their actual scope can be moved by commercial pressure: a single sponsored meal worth under twenty dollars shifts physicians' prescribing toward the sponsor's brand DeJong et al. 2016. Credentials are necessary, not sufficient.

Where the trained eye still gets caught

The protocol is a filter, not a force field. Six patterns slip past readers who think of themselves as skeptical.

  • The "they don't want you to know" frame. The absence of mainstream endorsement gets reframed as evidence of suppression rather than as the expected outcome of a weak claim. This is move #4 weaponised — turning the asymmetric signal upside down. The honest reading of "no Cochrane review, no guidelines body has touched it, no independent clinician recommends it" is that the claim has not survived the evidence. The conspiracy frame asks you to read that exact pattern as proof the claim is too dangerous to acknowledge. Almost always false.

  • The credential edit. A real degree in cardiology used to recommend hormonal protocols. A real PhD in physics used to opine on vaccine immunology. The credential is real; the scope it was earned in is not the scope it is being spent in. Check what the person was specifically trained in, not what they have letters for.

  • The "I almost died" hook. A vivid origin story — undiagnosed condition, conventional medicine failed me, then I found this — grants the speaker authority to recommend things that don't follow from the story. The story may be true. The interventions sold on the back of it are a separate question.

  • Parasocial override. After enough hours with someone's voice in your ear, their wrong claim feels like a friend's claim, and friend-claims get believed without the work. The fix is mechanical: when the recommendation comes from a face you "know," run the protocol harder, not lighter.

  • Citation theatre. Dense footnotes, journal-style layout, "47 sources cited." The visual pattern of rigour without the citations actually supporting the load-bearing claims when checked. Test one or two cites at random. If they don't hold, none of them do.

  • The symptom-mirror. A list of common, non-specific symptoms ("tired in the afternoon, brain fog, can't lose weight") framed as evidence of a specific named condition the post is selling a fix for. The list is engineered to describe almost everyone over thirty. Recognition is not diagnosis.

What it costs to keep scrolling without the filter

The damage is rarely a single bad decision. It's the accumulation across years of small ones — and a few rare large ones.

This month. The cart fills up. A liver supplement someone in your feed swore by, a magnesium spray, a patch for sleep, an adaptogen blend whose label lists fourteen plant extracts at undisclosed doses. Most of it does nothing. Some of it interacts with something you already take and you don't notice the interaction because the supplement bottle didn't have to warn you. Geller et al. estimate about 23,000 ED visits a year in the US are attributable to supplement adverse events — that's a measured floor, not a ceiling Geller et al. 2015.

This year. You spend somewhere between several hundred and a few thousand dollars on interventions a literate eye would have filtered out at first read. More expensive than the money: you spend the willingness. Every fad you tried that didn't work makes you slightly less ready to try the next thing — and the next thing might have been real. Cynicism that follows a bad wellness purchase is itself a cost; it lands on the real interventions later.

This decade. You internalise four named deficiencies you don't have. You read a symptom list, you recognise yourself in it, you spend a year half-convinced you have the named condition behind it, you cycle through the protocols sold for it. Friends ask if you're doing okay. The version of you that was going to spend the 2030s doing the boring fundamentals — sleeping, lifting, eating, seeing sunlight — instead spends them cycling through whatever was loud on the platform that quarter. The opportunity cost is the life you would have had with that attention spent elsewhere.

Once in a while, larger. Wakefield's fraudulent 1998 paper, retracted only in 2010, contributed to measurable declines in MMR vaccination and the measles resurgences that followed across multiple countries — direct mortality from a single bad citation that lived for over a decade The Lancet 2010. The COVID-era pseudoscience wave produced documented poisonings from people taking the recommended "remedies" Caulfield 2020. Most readers will never be the casualty. Some are. The protocol exists for the days you might be.

What changes when you start running it

The payoff is mostly negative space — things that don't happen. That makes it hard to feel in the moment and easy to underestimate. Read across a year, it's large.

Within a week. Three claims that would have caught you on Sunday don't. You spot the script — the white-coat backdrop, the symptom list that "describes you exactly," the cited paper you spent thirty seconds on that did not say what the post said it said. You keep scrolling. No purchase, no rabbit hole, no 11pm tab you'll close at midnight.

Within a month. The cart that was filling up doesn't. Two or three hundred dollars stays in the account. The mental load of half-believing you have four named deficiencies starts to lift; the body you live in stops being a problem someone in your feed has identified for you. Friends start asking what you think before they buy the next thing.

Within a year. You have stopped trying things. Not in a cynical way — you have a working filter, and the things that pass the filter (sleep regularity, strength training, sunlight, the boring fundamentals the catalogue keeps coming back to) are the things you actually do, with attention left over to do them well. The thousand-dollar wellness budget that was going to be next year's, isn't. Your peers cycle; you compound.

Over a decade. The skill ports. The same moves you apply to a health reel apply to a financial reel, a political reel, a "this is the future of work" reel. You become the person friends and family text "is this real?" — and the answer you give is usually right, because the protocol is the same. Your kids watch you do it. The version of you that was a soft target for whoever was selling the next thing stops existing.

Adjacent threads worth knowing exist. How to read a research paper end-to-end — what a p-value means, what a confidence interval is telling you, what risk-of-bias scoring catches — is a separate skill that lives one level deeper than the four moves above. The supplement industry specifically warrants its own treatment: why the 1994 carve-out exists, what the labels are allowed to claim, how third-party testing works (USP, NSF, Informed Sport). Cyberchondria and health anxiety — the mental-health pattern that builds when you treat your feed as a diagnostic tool — overlaps with this entry but is a distinct condition worth recognising in yourself. And the broader version of this skill — media literacy outside health, applied to financial, political, and technology claims — is the same four moves in a different costume.

·
677