Radioactive Baloney82%

If most scientists agree, the science is settled forever.

82%RADIOACTIVE BALONEY — DANGEROUSLY TOXIC
Dangerously misleading.
Overwhelmingly falseContradicts known factsPromotes false beliefsPotential for harm
Super Fresh Truth
Fishy Baloney
Stinky Baloney
Rotting Baloney
Radioactive Baloney
Zombie Baloney

✓ BLIND VALIDATION CONFIRMED THIS SCORE

Serve It Fresh

Ready to Serve10 servings

Serve it the way you want it

The Verdict

If most scientists agree, the science is settled forever.
82% RADIOACTIVE BALONEY DANGEROUSLY TOXIC
Verified blind by 5 frontier AIs · Baloney Inspection Report: baloney.ai/baloney/if-most-scientists-agree-the-science-is-settled-forever

The Rating Card

82% Radioactive Baloney card for this claim

The Order Ticket

00:54:27CLAIM RECEIVED — QUEUED FOR INSPECTION
00:55:14claude-opus-5 REPORTED — SCORE 82, CONFIDENCE 92
00:54:42gpt-5.5 REPORTED — SCORE 92, CONFIDENCE 93
00:54:51gemini-3.1-pro-preview REPORTED — SCORE 90, CONFIDENCE 99
00:54:43sonar-pro REPORTED — SCORE 80, CONFIDENCE 94
00:55:31grok-4.6 REPORTED — SCORE 82, CONFIDENCE 80
00:56:13PRIMARY MASTER GEMINI — SCORE 85
00:55:39BLIND VALIDATION PERPLEXITY — SCORE 85
00:56:13AGREEMENT CONFIRMED — DELTA 3

How This One Was Sliced

Station 1 · Blind Inspection — Five Graders, Zero Peeking

Each lab scored the claim independently, without seeing the others. Open a breakdown for its evidence, its sources, and how sure it was.

Anthropic · EQUAL WEIGHT · 46.4s

claude-opus-5

82%BALONEY

ROUND-1 BREAKDOWN
Evidence offered for the claim
  • Broad expert consensus is empirically one of the best available proxies for reliability: on well-tested core theories (germ theory, evolution by natural selection, the laws of thermodynamics, heliocentrism), agreement has held for a century or more without reversal.
  • Consensus positions are not mere opinion polls; they typically summarize converging lines of independent evidence. The ~97%+ agreement among publishing climate scientists that recent warming is human-caused (Oreskes 2004; Cook et al. 2013) reflects multiple independent datasets, not deference to authority.
  • In practical/policy terms, some questions really are closed for all decision-relevant purposes: that smoking causes lung cancer, that vaccines do not cause autism, or that the Earth is ~4.5 billion years old. Reopening these absent extraordinary new evidence would be unreasonable, so 'settled' is a defensible shorthand.
  • Formal assessment bodies (IPCC, National Academies, WHO) exist precisely because aggregated expert judgment outperforms individual or lay judgment, and their high-confidence conclusions have rarely been overturned.
  • The costs of treating settled findings as perpetually open are real: manufactured doubt about tobacco, ozone depletion, and climate change delayed protective action for decades.
Evidence against the claim
  • The word 'forever' makes the claim false as stated. Science is provisional by construction; every conclusion is held open to revision by new evidence. The Royal Society's founding motto 'Nullius in verba' ('take nobody's word for it') encodes this.
  • Documented consensus reversals: peptic ulcers were near-universally attributed to stress and acid until Marshall and Warren showed Helicobacter pylori causation — work initially rejected, later awarded the 2005 Nobel Prize in Physiology or Medicine.
  • Continental drift was dismissed by most geologists from 1912 into the 1950s, then became the foundation of plate tectonics once seafloor-spreading evidence arrived (USGS).
  • Newtonian mechanics was the near-unanimous consensus for ~200 years and was superseded (as a limiting case) by relativity and quantum mechanics — showing that even extremely well-supported consensus can be bounded or replaced.
  • Consensus is not itself evidence; it is a signal about evidence. Treating agreement as proof is an appeal to authority/majority. Kuhn's work on paradigm shifts documents how consensus can entrench assumptions that later collapse.
  • Replication problems show consensus can form on weak foundations: the Open Science Collaboration (2015) replicated fewer than half of 100 psychology findings, and a 2016 Nature survey found ~70% of researchers had failed to reproduce another scientist's experiment.
  • Ioannidis (2005) argued that in fields with small effect sizes, flexible analysis, and strong incentives, a large share of published (and therefore consensus-forming) findings may be false.
  • Scientific bodies themselves avoid 'settled forever' language: the IPCC assigns graded confidence and likelihood levels and revises conclusions across assessment cycles, which is the opposite of permanence.
  • The claim conflates degrees of establishment: 'most scientists agree' (e.g., a bare majority on a new preliminary result) is a far weaker condition than the near-total, multi-decade, multi-method agreement that underpins genuinely robust theories.
How sure this lab was

92/100 — the lab’s own confidence in the score above, not a second reading of the claim.

Sources

The Nobel Foundationother · 95 · U.S. Geological Survey — 'This Dynamic Earth: The Story of Plate Tectonics'gov · 94 · Environmental Research Letters (Cook et al., 2013)journal · 85 · Science (Oreskes, 2004, 'The Scientific Consensus on Climate Change')journal · 90 · Science (Open Science Collaboration, 2015, 'Estimating the reproducibility of psychological science')journal · 92 · PLoS Medicine (Ioannidis, 2005, 'Why Most Published Research Findings Are False')journal · 85 · Nature (Baker, 2016, '1,500 scientists lift the lid on reproducibility')journal · 90 · Intergovernmental Panel on Climate Change, AR6 Working Group Igov · 93 · NASAgov · 92 · The Royal Society (motto 'Nullius in verba')other · 88

OpenAI · EQUAL WEIGHT · 15.2s

gpt-5.5

92%BALONEY

ROUND-1 BREAKDOWN
Evidence offered for the claim
  • A broad scientific consensus is often a strong indicator that a question has been tested repeatedly and that the best available evidence points in one direction; for example, NASA summarizes that multiple studies find overwhelming expert agreement that recent climate warming is human-caused.
  • Some scientific conclusions become extremely durable because they are supported by converging evidence from many fields; examples include the harms of cigarette smoking, summarized by the U.S. National Cancer Institute, and the basic framework of plate tectonics described by the U.S. Geological Survey.
  • The National Academies emphasizes that scientific knowledge is reliable and durable when supported by repeated observation, testing, and peer scrutiny, so majority agreement among relevant experts should not be dismissed as mere opinion.
Evidence against the claim
  • The word 'forever' makes the claim false: science is methodologically provisional, and even very strong consensuses remain open to revision if better evidence appears.
  • History contains major cases where a prevailing scientific view changed. The Nobel Prize press release for the 2005 Medicine Prize notes that Barry Marshall and Robin Warren overturned the conventional view that stress and lifestyle were the main causes of peptic ulcers by showing the role of Helicobacter pylori infection.
  • Plate tectonics is another example: Alfred Wegener's continental drift hypothesis was initially rejected by many scientists, but later evidence from seafloor spreading, paleomagnetism, and earthquakes led to the modern plate-tectonics consensus.
  • A better formulation would be: 'If most relevant scientists agree, that is strong evidence that a conclusion is currently well supported, but science is never settled forever.'
How sure this lab was

93/100 — the lab’s own confidence in the score above, not a second reading of the claim.

Sources

NASAgov · 95 · National Cancer Institutegov · 95 · U.S. Geological Surveygov · 93 · Nobel Prizeother · 90 · National Academies Pressother · 94

Google · EQUAL WEIGHT · 23.6s

gemini-3.1-pro-preview

90%BALONEY

ROUND-1 BREAKDOWN
Evidence offered for the claim
  • Scientific consensus represents the most reliable, evidence-based understanding of a topic at any given time, filtering out individual biases through rigorous peer review and replication.
  • For deeply established paradigms (e.g., thermodynamics, heliocentrism, germ theory), the consensus is supported by such a vast amount of converging evidence that the core principles are practically treated as settled facts.
  • When a vast majority of experts agree, the likelihood of the consensus being entirely wrong is extremely low, making it the most rational foundation for public policy and technological development.
Evidence against the claim
  • The scientific method is fundamentally based on falsifiability and empirical observation; no scientific theory is considered proven 'forever,' as it must always remain open to being challenged by new, verifiable evidence.
  • History demonstrates that scientific consensuses can be overturned or significantly modified through 'paradigm shifts' (e.g., the transition from the miasma theory of disease to germ theory, Newtonian physics to Einsteinian relativity, or static continents to plate tectonics).
  • Declaring science 'settled forever' fosters dogmatism, which is antithetical to the scientific process of continuous questioning, testing, and refinement of existing models.
How sure this lab was

99/100 — the lab’s own confidence in the score above, not a second reading of the claim.

Sources

American Association for the Advancement of Science (AAAS)edu · 98 · Stanford Encyclopedia of Philosophyedu · 95 · UC Berkeley Museum of Paleontology (Understanding Science)edu · 95

Perplexity · EQUAL WEIGHT · 15.6s

sonar-pro

80%BALONEY

ROUND-1 BREAKDOWN
Evidence offered for the claim
  • In many domains, when **most relevant experts agree after extensive testing**, findings become highly reliable and are treated as effectively settled for practical purposes (e.g., gravity existing, smoking causing lung cancer), making them extremely unlikely to be overturned even if details continue to be refined.[2][5][6]
  • Philosophers and scientists sometimes use the term **"settled science"** for areas where evidence is very strong, results are reproducible, and independent lines of inquiry converge on the same explanation; in these cases, consensus is a good indicator that the core claim is robust and will remain valid within its domain of applicability.[2][5][6][14]
  • For applied decisions (public health, engineering, climate policy), **broad scientific consensus functions as a stable basis for action**: institutions like the National Academies describe topics where the evidence is strong and consensus is high as effectively resolved for policy purposes, even though science itself continues to refine estimates and mechanisms.[4][8][10]
  • The existence of long‑standing, durable consensuses (e.g., plate tectonics, germ theory of disease, evolution by natural selection) shows that **once a consensus forms around a well‑tested framework, the likelihood of complete reversal becomes extremely low**, lending support to the idea that such science is "settled" in a practical sense.[2][5][6]
  • Scientific consensus is not just a poll of opinions; it typically arises from **large bodies of consistent, publicly scrutinized evidence** that survive repeated attempts at falsification, which makes post‑consensus radical changes rare and thus supports treating many consensus positions as enduring.[1][4][6][9][10]
Evidence against the claim
  • Science is explicitly a **tentative, self‑correcting process**, and authoritative bodies emphasize that even in areas called "settled" or well‑established, knowledge is still partial and subject to refinement as new evidence emerges; nothing is literally final or "forever".[1][4][5][6][8]
  • There are well‑documented historical cases where a strong or near‑unanimous consensus was later overturned or substantially revised—such as the rejection then acceptance of **continental drift/plate tectonics** and the shift from stress and acid to **Helicobacter pylori** infection as the main cause of peptic ulcers—showing that majority agreement does not guarantee permanence.[2][15]
  • Many scientists and commentators argue that **"the science is settled" is a misleading or political slogan**, not a scientific concept: consensus may indicate current best understanding, but using it as if it ends debate or exploration contradicts the norms of open inquiry and ongoing testing.[3][7][11][12][14]
  • Expert writing on consensus stresses that it is **rooted in the weight and quality of evidence at a given moment**, not in the mere fact that most scientists agree; future high‑quality evidence can still modify or even overturn existing consensus, so majority agreement alone cannot make science settled forever.[1][4][6][10][14]
  • Some critiques note that invoking consensus as final truth can be used to **suppress minority views that later turn out to be important**, pointing to episodes where initially marginalized researchers were later vindicated, which counsels skepticism toward claims that consensus makes a topic permanently closed.[7][12][15]
  • Philosophical analyses of scientific method (e.g., drawing on Peirce and others) emphasize that **fallibilism**—the idea that any empirical claim could, in principle, be revised—is central to science; thus, no level of agreement can logically guarantee that a claim is safe from future revision.[2][7][11][12][14]
How sure this lab was

94/100 — the lab’s own confidence in the score above, not a second reading of the claim.

Sources

NASAgov · 97 · National Academies of Sciences, Engineering, and Medicineedu · 98 · National Academies of Sciences, Engineering, and Medicineedu · 98 · National Academies of Sciences, Engineering, and Medicineedu · 98 · PubMed / National Library of Medicinegov · 97 · American Geophysical Union (AGU) / ADSjournal · 95 · Boston University Institute for Global Sustainabilityedu · 93 · LiveSciencenews · 88 · Skeptical Raptorother · 80 · PolitiFactfactcheck · 90 · Brownstone Instituteother · 60 · Grand Junction Daily Sentinelnews · 75

xAI · EQUAL WEIGHT · 63.6s

grok-4.6

82%BALONEY

ROUND-1 BREAKDOWN
Evidence offered for the claim
  • Near-unanimous expert agreement on core empirical facts (heliocentrism, germ theory, DNA as genetic material) has remained stable for many decades and is treated as operationally settled in education, engineering, and medicine.
  • Legal, regulatory, and clinical systems routinely treat high-consensus scientific conclusions as sufficiently final for binding decisions.
Evidence against the claim
  • Science is methodologically provisional: new evidence can and has overturned prior majority views (peptic ulcers attributed to stress/diet until Helicobacter pylori; continental drift rejected then accepted as plate tectonics; Newtonian mechanics superseded in relativistic and quantum regimes).
  • Philosophers of science and practicing scientists describe knowledge as falsifiable and open to revision, not closed 'forever' by a vote of current experts.
  • Authoritative assessments (e.g., IPCC) use calibrated likelihood/confidence language rather than declaring findings settled for all time.
How sure this lab was

80/100 — the lab’s own confidence in the score above, not a second reading of the claim.

Sources

Nobel Prizeother · 95 · Stanford Encyclopedia of Philosophyedu · 92 · IPCCgov · 90 · USGSgov · 93

Station 2 · The Masters

Primary Master · drawn at random

gemini-3.1-pro-preview

85% BALONEY

The claim fundamentally misrepresents the scientific method by asserting that a consensus equates to permanent truth. While broad agreement among experts is a strong indicator of evidence quality and is necessary for practical decision-making, core scientific principles mandate falsifiability. Historical reversals in medicine and physics prove that even overwhelming consensus can be overturned, making the absolute 'settled forever' framing entirely false.

All five evaluators agreed that the inclusion of the word 'forever' makes the statement false. They unanimously noted that while a strong consensus is highly reliable for practical purposes, the scientific method dictates that all conclusions remain provisional and subject to revision upon the discovery of new evidence.

Blind Validation Master · never saw the Primary’s work

sonar-pro

85% BALONEY

All five reports agree on a common core: **broad, durable scientific consensus is a very strong indicator of reliability for practical purposes**, but science is inherently provisional and no level of agreement can make a claim literally settled “forever.” Key points of agreement across reports: - Consensus on deeply established frameworks (heliocentrism, germ theory, plate tectonics, evolution, thermodynamics, smoking causing lung cancer) has remained stable for many decades to over a century and is treated as *operationally settled* in education, engineering, medicine, and public policy.[Report 1][Report 2][Report 3][Report 4][Report 5] - Such consensuses are built on large, converging bodies of evidence, repeated testing, and peer scrutiny; they are not mere opinion polls.[Report 2][Report 3][Report 4][Report 5] - For many practical decisions (public health, climate policy, engineering safety), high‑confidence consensus is rightly treated as the best available foundation and effectively “settled” for policy purposes.[Report 1][Report 2][Report 3][Report 4][Report 5] However, all reports also stress that the **stronger, literal reading** of the claim (science settled *forever* once most scientists agree) is wrong: - Science is **methodologically provisional** and explicitly fallibilist: any empirical claim remains, in principle, open to revision if new, better evidence appears.[Report 1][Report 2][Report 3][Report 4][Report 5] - Historical examples show **consensus reversals or major revisions**: peptic ulcers (from stress/acid to Helicobacter pylori), continental drift/plate tectonics, miasma theory to germ theory, Newtonian mechanics to relativity/quantum mechanics.[Report 1][Report 2][Report 3][Report 4][Report 5] - Philosophers and institutions (e.g., Royal Society motto, IPCC practice, National Academies) explicitly avoid language implying permanence and instead use calibrated confidence and likelihood, revising conclusions over time.[Report 1][Report 2][Report 3][Report 5] - Treating consensus itself as proof is an appeal to authority/majority; consensus is a *signal about the weight of evidence*, not a guarantee against future revision.[Report 2][Report 3] - Declaring science “settled forever” encourages dogmatism and can be used to suppress minority views that later prove important.[Report 2][Report 3][Report 4] On the Baloney Scale, the statement must be scored **as written**, including the word “forever.” The evidential consensus among the evaluators is: - The *reasonable* version (“consensus makes claims highly reliable and operationally settled”) would be in the low-baloney, mostly-true band. - The **actual wording** (“settled forever”) overreaches the evidence and directly contradicts core scientific norms and history. All five recommended scores are in the 80–92 range with high confidence (80–99), firmly placing the claim in **Radioactive Baloney**: overwhelmingly false, with potential for harm if used to shut down inquiry or policy debate. Averaging and qualitatively synthesizing their recommendations (82, 80, 82, 90, 92) yields a central tendency around the mid‑80s. Given the unanimous emphasis that “forever” is the crucial, invalid part, an integrated score of **85** best reflects that the claim is **largely wrong and misleading as stated**, even though a more nuanced, non‑eternal formulation would be much closer to true.

AGREEMENT TEST PASSED — BOTH MASTERS SCORED 85% · BLIND VALIDATION CONFIRMED THIS SCORE · NO RE-EVALUATION REQUIRED

The Evidence

Evidence offered for the claim

  • Consensus as a proxy for reliability In well-tested domains like germ theory, thermodynamics, and heliocentrism, widespread agreement has held for generations and functions as a stable basis for applied decision-making.
  • Actionable certainty in policy For applied decisions in public health and engineering, overwhelming consensus is treated as practically settled, as reopening issues without extraordinary new evidence would be unreasonable.
  • Consensus guarantees permanence DEBUNKED — The assertion that majority agreement among scientists finalizes a theory forever is explicitly contradicted by the core scientific principle of falsifiability.

Evidence against the claim

  • Science is inherently provisional The scientific method is built on falsifiability; no conclusion is proven 'forever,' and all models must remain open to testing against new empirical observations.
  • Historical paradigm shifts Documented reversals—such as the acceptance of plate tectonics and the discovery that H. pylori causes peptic ulcers—demonstrate that overwhelming scientific consensus can be overturned.
  • Replication and self-correction Replication challenges in fields like psychology demonstrate that consensus can occasionally form on weak foundations, highlighting why ongoing scrutiny is essential.
  • Calibrated institutional confidence Authoritative bodies like the IPCC do not declare findings 'settled forever,' but instead use graded confidence and likelihood language that is revised across assessment cycles.

Sources · Reliability · Why Accepted or Discounted

SourceTypeReliabilityRuling
The Nobel Foundation / Nobel Prizeother95ACCEPTED Highly credible primary source for historical shifts in scientific paradigms, specifically regarding the 2005 Medicine Prize.
Stanford Encyclopedia of Philosophyedu95ACCEPTED Prestigious academic resource offering rigorous analyses of the philosophy of science and falsifiability.
Intergovernmental Panel on Climate Change (IPCC)gov93ACCEPTED Top-tier international scientific body demonstrating how consensus uses calibrated confidence language rather than absolute certainty.
U.S. Geological Survey (USGS)gov94ACCEPTED Authoritative government scientific agency providing historical context on the plate tectonics paradigm shift.
NASAgov97ACCEPTED Highly reliable scientific institution reflecting how consensus is summarized and evaluated.
National Academies of Sciences, Engineering, and Medicineedu98ACCEPTED Gold-standard scientific advisory body detailing how strong consensus forms a basis for action.
PubMed / National Library of Medicinegov97ACCEPTED Highly reliable repository of peer-reviewed biomedical literature.
American Geophysical Union (AGU) / ADSjournal95ACCEPTED Reputable professional scientific organization and publisher.
Boston University Institute for Global Sustainabilityedu93ACCEPTED Credible academic institute reflecting institutional scientific perspectives.
LiveSciencenews88ACCEPTED Reliable popular science outlet accurately conveying scientific methodology to the public.
Skeptical Raptorother80ACCEPTED Acceptable secondary blog focused on science advocacy, consistent with broader expert consensus.
PolitiFactfactcheck90ACCEPTED Established fact-checking organization providing verified context on scientific claims.
Brownstone Instituteother60DISCOUNTED Discounted due to lower reliability (60) and ideological focus; the high-quality institutional sources provided are sufficient for the evaluation.
Grand Junction Daily Sentinelnews75ACCEPTED Local news source accepted for reflecting general public discourse on scientific consensus.
Environmental Research Lettersjournal85ACCEPTED Peer-reviewed journal that published foundational studies on scientific consensus.
Sciencejournal92ACCEPTED Top-tier scientific journal hosting critical papers on consensus and reproducibility.
PLoS Medicinejournal85ACCEPTED Respected open-access journal hosting highly cited literature on research methodology and falsehoods.
Naturejournal90ACCEPTED World-leading multidisciplinary scientific journal, source of key surveys on reproducibility.
The Royal Societyother88ACCEPTED Historic and prestigious scientific academy whose motto embodies the provisional nature of science.
American Association for the Advancement of Science (AAAS)edu98ACCEPTED Major scientific organization accurately summarizing the rigorous standards of scientific evidence.

Serve It Fresh

Ready to Serve10 servings

Serve it the way you want it

The Verdict

If most scientists agree, the science is settled forever.
82% RADIOACTIVE BALONEY DANGEROUSLY TOXIC
Verified blind by 5 frontier AIs · Baloney Inspection Report: baloney.ai/baloney/if-most-scientists-agree-the-science-is-settled-forever