Dishonesty For the Greater Good
2010.11.13 prev next
FROM Jonah Lehrer’s “Beware Our Blind Seers” (The Wall Street Journal):
[Pundits] sound as if they know what they’re talking about.
But do they? Philip Tetlock, a psychologist at the University of California, Berkeley, has spent 25 years trying to find out. ...
By the end of the study, Mr. Tetlock had quantified 82,361 predictions.
How did the experts do? When it came to predicting the likelihood of an outcome, the vast majority performed worse than random chance.
How could pundits be worse than random guessing? Lehrer’s article cites “overconfidence,” “confirmation bias,” and “preconceptions” as the explanation.
That seems a little too vague to me. Actually, now that I think about it some more, it seems impossible. How can overconfidence make you worse than random guessing? It can’t. Same with confirmation bias, or preconceptions. Any flaw in your ability to predict the future could make your predictions, on average, worse than if you didn’t have that flaw. But not worse than random guessing. The accuracy of random guessing is the absolute bottom, below which you cannot go, no matter how bad your predictive flaws may be.
So how did Tetlock get these results? Here’s my theory:
Pundits, like everyone else, have preferences of what they would like to see happen. When pundits sense that there’s a good chance that their preferred outcome will not be realized, they feel a more urgent need to persuade others that it will be. This is especially true if the outcome is determined by some sort of popular consensus, like voting in an election, or buying or selling stock in a company, or choosing which company’s products to buy — then the pundits feel they must use their influence to push the outcome in the direction they want it to fall.
Of course, few, if any, pundits have enough influence to actually prevent the outcome from falling in their non-preferred direction, so that’s what it does. And then you can chalk up another incorrect prediction.
When an outcome seems likely to go the way pundits want it to, they feel little need to push it in that direction, and so are less likely to speak out on that subject.
Pundits are actually better than chance at knowing what’s likely to happen. They appear to be worse than chance because they aren’t trying to achieve accuracy in predicting trends — instead they’re trying to use their public predictions to push against trends they can see coming, and don’t like. Overconfidence, confirmation bias, preconceptions, and all other flaws in pundits’ ability to predict the future, can only drive them down to the accuracy of random guessing. To go below that, it takes real predictive ability plus intentional dishonesty.
Capitalism
Capitalism makes a nation stronger. It makes a nation that is more easily able to fend off attacks from other nations, and that is more able to take over other nations, should it decide that it’s in its best interest to do so.
But that’s all capitalism does. Capitalism does not make people’s lives better. There are lots of people whose lives are miserable under capitalism, and the capitalists have a funny answer to that. Capitalists almost never argue in favor of capitalism on the basis of national strength or longevity or power over other nations. They almost always argue in favor of capitalism on the basis that it makes our lives better. But then when you start talking about how so many people in capitalism are extremely miserable, unhappy with their situation, with what they’re able to get under capitalism, then the capitalists have a very funny answer, and that answer is that those people aren’t supposed to be unhappy. That they’re getting exactly what they deserve, exactly what they legitimately should, as per the rules of capitalism. And that they have no right to be unhappy about that. And if they are unhappy about that, then it’s their own fault, and they deserve that unhappiness until they decide to stop feeling that way. The capitalists don’t come out and say it that bluntly, but that’s what they mean.
And this is very strange because, of course, on the one hand the capitalists are trying to say that capitalism achieves a better result, but on the other hand they dismiss any flaws in that result by simply saying that those flaws are not flaws. That when people are unhappy under capitalism, it’s a legitimate unhappiness, it’s an unhappiness they’re supposed to feel. Until they decide not to feel that way.
But what about the Soviet Union, and how much worse living conditions were there than in the USA? Doesn’t that prove capitalism makes our lives better? Wouldn’t someone who was transported from the USSR to the USA be overjoyed at their better quality of life, or traumatized if transported in the opposite direction?
Not exactly. What percentage of the USSR’s population was transported to the USA as described above? Nearly 0%. How many in the opposite direction? Nearly 0%. It’s a fantasy scenario that virtually never happened. How would a person from five hundred years ago feel about their material possessions and opportunities if transported to the present? Overjoyed, perhaps. How would a present-day person feel about their possessions and opportunities if transported to five hundred years ago? Horrified, most likely.
So were people profoundly more miserable and dissatisfied five hundred years ago than they are today? Not as far as we can tell, no. Are we all satisfied and happy with our lives because we have more possessions and opportunities than people did five hundred years ago? Hardly.
Hmmm — the USSR crumbled, didn’t it? Doesn’t that count for something? It sure does. National strength and power.
There isn’t any non-circular way to justify capitalism except on national strength; the ability to fend off and/or take over other nations.
Now, capitalists generally don’t defend it that way. Why not? Well, for one, they might be repulsed by that reality. They want to believe that capitalism yields something better. But then there’s an even more important reason, and that is that they’re trying to encourage people to vote capitalist. And you can’t encourage people to vote capitalist by talking about national strength or the ability to fend off attacks, or anything like that. You have to make people think that their lives are going to be personally better.
If people don’t think their lives are going to be better, then they’re not going to vote that way. And so unless our country is under imminent threat of attack by some very powerful aggressor nation — which, ever since the fall of the USSR, it isn’t; even 9/11 was a drop in the bucket compared to World War II — then you have to ask, how do you convince people to vote for capitalism? Not by telling them they’re going to be miserable but safe. No, you convince them to vote for capitalism by telling them that they will be happier under capitalism. And by telling them that those who say they’re unhappy under capitalism are just malicious. That they shouldn’t feel that way, or that they’re lying, or that they’re telling the truth but their misery is self-created, because they ought to be happy with what they have.
Capitalists have to come up with an argument that has a decent chance of persuading people to vote capitalist, and that’s what they’re trying to do. They’re not really trying to tell the truth about capitalism — I’m telling you the truth about capitalism right here. Capitalists want capitalism. They don’t want to tell the truth that might or might not cause people to vote capitalist.
Religion and Darwinism
It’s kind-of the same thing with religion. If you believe people’s lives will be better with religion, you have to choose a specific religion and promote it exclusively. You can’t go around saying, “Join one of the major religions; your life will be better!” because that’s saying, in effect, that religions are myths; falsehoods.
And Darwinists too: There are so many people — intelligent and educated — who, when asked, “Do you believe that random mutation and natural selection produced life’s adaptive complexity that we see on Earth today?” think that they’re really being asked, “Do you believe in freedom, democracy, technology, and scientific progress?” (As opposed to theocracy, dictatorship, 1984, etc.) And so they answer accordingly.
And it’s even worse than that. If they’re asked the question in a more specific way, like, “Do you really believe that there’s strong evidence that random mutation and natural selection can do this? You’re not just saying they can because you want to promote freedom, democracy, etc.?” then they think even more that they’re being asked if they believe in freedom, democracy, etc., and so they answer even more vociferously that yes, yes, random mutation and natural selection definitely can do this, and that’s really why I’m saying they can; because they can, and did.
It’s a situation where the belief that we’re going to achieve a certain goal in society totally overwhelms the ability to speak honestly about a subject, or even the desire to.

Update 2011.04.01 — added “Actually, now ... these results?” and “Overconfidence, confirmation ... below that.”
See also:
iPhone Party-Poopers Redux
&
Silly iPad Spoilsports
prev next
Hear, hear
prev next
Best recent articles
Make Your Own FBI Backdoor, Right Now
Polygon Triangulation With Hole
The Legacy of Windows Phone
Palm Fan
Vivek Wadhwa, Scamster Bitcoin Doomsayer
Fanboy Features (regularly updated)
When Starting A Game of Chicken With Apple, Expect To Lose — hilarious history of people who thought they could bluff Apple into doing whatever they wanted.
A Memory of Gateway — news chronology of Apple’s ascendancy to the top of the technology mountain.
iPhone Party-Poopers Redux and Silly iPad Spoilsports — amusing litanies of industry pundits desperately hoping iPhone and iPad will go away and die.
Embittered Anti-Apple Belligerents — general anger at Apple’s gi-normous success.
RSS FEED
My books
Now available on Apple Books!

Links
Daring Fireball
The Loop
RoughlyDrafted
Macalope
Red Meat
Despair, Inc.
Real Solution #9 (Mambo Mania Mix) over stock nuke tests. (OK, somebody made them rip out the music — try this instead.)
Ernie & Bert In Casino
Great Explanation of Star Wars
Best commercials (IMO) from Super Bowl 41, 43, 45, 46, 47, 53 and 55
Kirk & Spock get Closer
American football explained.
TV: Severance; Succession; The Unlikely Murderer; Survivor; The Jinx; Breaking Bad; Inside Amy Schumer
God’s kitchen
Celebrity Death Beeper — news you can use.
Making things for the web.
RedQueenCoder.
My vote for best commercial ever. (But this one’s a close second, and I love this one too.)
Recent commercials I admire: KFC, Audi, Volvo
Best reggae song I’ve discovered in quite a while: Virgin Islands Nice
Aquarium by Saint-Saëns. What a superb performance, easily the equal of the Bernstein recording I grew up with. And so nice to see it performed up close in a high-quality video. But how awful when YouTube popovers spoil the final seconds, and an incredibly loud ad starts playing as soon as the music stops. Sickening. I guess this is the price we pay for having free, immediate access to such beautiful works of art.
d120 dice: You too (like me) can be the ultimate dice nerd.
WiFi problems? I didn’t know just how bad my WiFi was until I got eero.
Favorite local pad thai: Pho Asian Noodle on Lane Ave. Yes, that place; blame Taco Bell for the amenities. Use the lime, chopsticks, and sriracha. Yummm.
Um, could there something wrong with me if I like this? Or this?
Reggae recreation of Ozzy singing Iron Man. The cheery melancholy of the style, and the clarity of the lyrics, make the story sadder and realer to me.
This entire site as a zip file — last updated 2025.09.03
Previous articles
The West Coast Is Totally Doomed
Malicious Requirement, Non-Malicious Compliance
Well-Regulated Militia
Stroking Their Bruised Egos
EU vs Apple
Scioto Grove Tower NOPE
Fitness Startup Is Hard
Sweeney Translation
Collatz, Revisited
Downtown Isn’t Coming Back
Stig
Gaston
Nuclear War
Wolfspeare
Engström’s Motive
Google’s Decision
Warrening
The Two Envelopes Problem, Solved
The Practical Smartphone Buyer
Would Apple Actually Exit the EU Or UK?
See You Looked
Blackjack Strategy Card (Printable)
Swan Device 1956 — Probable Shape
Pu
RGB-To-Hue Conversion
Polygon Triangulation With Hole
One-Point Implosion: “Palm Fan”
Implosion: Were Those Two-Speed Lenses Really Necessary?
Apple Wants User/Developer Choice; Its Enemies Want Apple Ruin
Tim Sweeney Plays Dumb
The Jury of One
The Lesson of January 6
Amnesia Is Not A Good Plot
I Was Eating for 300 lbs, Not 220
Action Arcade Sounds and Reality
The Flea Market and the Retail Store
Squaring the Impossible
Yes, Crocodiles Are Dinosaurs — Duh
Broccoli and Apples Are Not the Antidote To Donuts and Potato Chips
Cydia and “Competition”
The Gift of Nukes
Prager University and the Anti-Socialists’ Big Blind Spot
In Defense of Apple’s 30% Markup, Part 2
In Defense of Apple’s 30% Markup
Make Your Own FBI Backdoor, Right Now
Storm
The Legacy of Windows Phone
Mindless Monsters
To the Bitter End
“Future Shock” Shock
Little Plutonium Boy
The iPhone Backdoor Already Exists
The Impulse To Be Lazy
HBO’s “Meth Storm” BS
Judos vs. Pin Place
Vizio M-Series 65" LCD (“LED”) TV — Best Settings (IMHO)
Tasting Vegemite (Bucket List)
The IHOP Coast
The Surprise Quiz Paradox, Solved
Apple, Amazon, Products, and Services — Not Even Close
Nader’s Open Blather
Health — All Or Nothing?
Vivek Wadhwa, Scamster Bitcoin Doomsayer
Backwards Eye Wiring — the Optical Focus Hypothesis
Apple’s Cash Is Not the Key
Nothing More Angry Than A Cornered Anti-Apple
Let ’Em Glow
The Ultimate, Simple, Fair Tax
Compassion and Vision
When Starting A Game of Chicken With Apple, Expect To Lose
The Caveat
Superb Owl
NavStar
Basic Reproduction Number
iBook Price-Fixing Lawsuit Redux — Apple Won
Delusion Made By Google
Religion Is A Wall
It’s Not A Criticism, It’s A Fact
Michigan Wolverines 2014 Football Season In Review
Sprinkler Shopping
Why There’s No MagSafe On the New MacBook
Sundar Pichai Says Devices Will Fade Away
The Question Every Apple Naysayer Must Answer
Apple’s Move To TSMC Is Fine For Apple, Bad For Samsung
Method of Implementing A Secure Backdoor In Mobile Devices
How I Clip My Cat’s Nails
Die Trying
Merger Hindsight
Human Life Decades
Fire and the Wheel — Not Good Examples of A Broken Patent System
Nobody Wants Public Transportation
Seasons By Temperature, Not Solstice
Ode To Coffee
Starting Over
FaceBook Messenger — Why I Don’t Use It
Happy Birthday, Anton Leeuwenhoek
Standard Deviation Defined
Not Hypocrisy
Simple Guide To Progress Bar Correctness
A Secure Backdoor Is Feasible
Don’t Blink
Predictive Value
Answering the Toughest Question About Disruption Theory
SSD TRIM Command In A Nutshell
The Enderle Grope
Aha! A New Way To Screw Apple
Champagne, By Any Other Maker
iOS Jailbreaking — A Perhaps-Biased Assessment
Embittered Anti-Apple Belligerents
Before 2001, After 2001
What A Difference Six Years Doesn’t Make
Stupefying New Year’s Stupidity
The Innovator’s Victory
The Cult of Free
Fitness — The Ultimate Transparency
Millions of Strange Devotees and Fanatics
Remember the iPod Killers?
Theory As Simulation
Four Analysts
What Was Christensen Thinking?
The Grass Is Always Greener — Viewing Angle
Is Using Your Own Patent Still Allowed?
The Upside-Down Tech Future
Motive of the Anti-Apple Pundit
Cheating Like A Human
Disremembering Microsoft
Security-Through-Obscurity Redux — The Best of Both Worlds
iPhone 2013 Score Card
Dominant and Recessive Traits, Demystified
Yes, You Do Have To Be the Best
The United States of Texas
Vertical Disintegration
He’s No Jobs — Fire Him
A Players
McEnroe, Not Borg, Had Class
Conflict Fades Away
Four-Color Theorem Analysis — Rules To Limit the Problem
The Unusual Monopolist
Reasonable Projection
Five Times What They Paid For It
Bypassable Security Certificates Are Useless
I’d Give My Right Arm To Go To Mars
Free Advice About Apple’s iOS App Store Guidelines
Inciting Violence
One Platform
Understanding IDC’s Tablet Market Share Graph
I Vote Socialist Because...
That Person
Product Naming — Google Is the Other Microsoft
Antecessor Hypotheticum
Apple Paves the Way For Apple
Why — A Poem
App Anger — the Supersized-Mastodon-In-the-Room That Marco Arment Doesn’t See
Apple’s Graphic Failure
Why Microsoft Copies Apple (and Google)
Coders Code, Bosses Boss
Droidfood For Thought
Investment Is Not A Sure Thing
Exercise is Two Thirds of Everything
Dan “Real Enderle” Lyons
Fairness
Ignoring the iPod touch
Manual Intervention Should Never Make A Computer Faster
Predictions ’13
Paperless
Zeroth — Why the Century Number Is One More Than the Year Number
Longer Than It Seems
Partners: Believe In Apple
Gun Control: Best Arguments
John C. Dvorak — Translation To English
Destructive Youth
Wiens’s Whine
Free Will — The Grand Equivocation
What Windows-vs.-Mac Actually Proved
A Tale of Two Logos
Microsoft’s Three Paths
Amazon Won’t Be A Big Winner In the DOJ’s Price-Fixing Suit
Infinite Sets, Infinite Authority
Strategy Analytics and Long Term Accountability
The Third Stage of Computing
Why 1 Isn’t Prime, 2 Is Prime, and 2 Is the Only Even Prime
Readability BS
Lie Detection and Psychos
Liking
Steps
Microsoft’s Dim Prospects
Humanity — Just Barely
Hanke-Henry Calendar Won’t Be Adopted
Collatz Conjecture Analysis (But No Proof; Sorry)
Rock-Solid iOS App Stability
Microsoft’s Uncreative Character
Microsoft’s Alternate Reality Bubble
Microsoft’s Three Ruts
Society’s Fascination With Mass Murder
PlaysForSure and Wikipedia — Revisionism At Its Finest
Procrastination
Patent Reform?
How Many Licks
Microsoft’s Incredible Run
Voting Socialist
Darwin Saves
The Size of Things In the Universe
The Self-Fulfilling Prophecy That Wasn’t
Fun
Nobody Was In Love With Windows
Apples To Apples — How Anti-Apple Pundits Shoot Themselves In the Foot
No Holds Barred
Betting Against Humanity
Apple’s Premium Features Are Free
Why So Many Computer Guys Hate Apple
3D TV With No Glasses and No Parallax/Focus Issues
Waves With Particle-Like Properties
Gridlock Is Just Fine
Sex Is A Fantasy
Major Player
Why the iPad Wannabes Will Definitely Flop
Predators and Parasites
Prison Is For Lotto Losers
The False Dichotomy
Wait and See — Windows-vs-Mac Will Repeat Itself
Dishonesty For the Greater Good
Barr Part 2
Enough Information
Zune Is For Apple Haters
Good Open, Bad Open
Beach Bodies — Who’s Really Shallow?
Upgrade? Maybe Not
Eliminating the Impossible
Selfish Desires
Farewell, Pirate Cachet
The Two Risk-Takers
Number of Companies — the Idiocy That Never Dies
Holding On To the Solution
Apple Religion
Long-Term Planning
What You Have To Give Up
The End of Elitism
Good and Evil
Life
How Religion Distorts Science
Laziness and Creativity
Sideloading and the Supersized-Mastodon-In-the-Room That Snell Doesn’t See
Long-Term Self-Delusion
App Store Success Won’t Translate To Books, Movies, and Shows
Silly iPad Spoilsports
I Disagree
Five Rational Counterarguments
Majority Report
Simply Unjust
Zooman Science
Reaganomics — Like A Diet — Works
Free R&D?
Apple’s On the Right Track
Mountains of Evidence
What We Do
Hope Conquers All
Humans Are Special — Just Not That Special
Life = Survival of the Fittest
Excuse Me, We’re Going To Build On Your Property
No Trademark iWorries
Knowing
Twisted Excuses
The Fall of Google
Real Painters
The Meaning of Kicking Ass
How To Really Stop Casual Movie Disc Ripping
The Solitary Path of the High-Talent Programmer
Fixing, Not Preaching
Why Blackmail Is Still Illegal
Designers Cannot Do Anything Imaginable
Wise Dr. Drew
Rats In A Too-Small Cage
Coming To Reason
Everything Isn’t Moving To the Web
Pragmatics, Not Rights
Grey Zone
Methodologically Dogmatic
The Purpose of Language
The Punishment Defines the Crime
Two Many Cooks
Pragmatism
One Last Splurge
Making Money
What Heaven and Hell Are Really About
America — The Last Suburb
Hoarding
What the Cloud Isn’t For
Diminishing Returns
What You’re Seeing
What My Life Needs To Be
Taking An Early Retirement
Office Buildings
A, B, C, D, Pointless Relativity
Stephen Meyer and Michael Medved — Where Is ID Going?
If You Didn’t Vote — Complain Away
iPhone Party-Poopers Redux
What Free Will Is Really About
Spectacularly Well
Pointless Wrappers
PTED — The P Is Silent
Out of Sync
Stupid Stickers
Security Through Normalcy
The Case For Corporate Bonuses
Movie Copyrights Are Forever
Permitted By Whom?
Quantum Cognition and Other Hogwash
The Problem With Message Theory
Bell’s Boring Inequality and the Insanity of the Gaps
Paying the Rent At the 6 Park Avenue Apartments
Primary + Reviewer — An Alternative IT Plan For Corporations
Yes Yes Yes
Feelings
Hey Hey Whine Whine
Microsoft About Microsoft Visual Microsoft Studio Microsoft
Hidden Purple Tiger
Forest Fair Mall and the Second Lamborghini
Intelligent Design — The Straight Dope
Maxwell’s Demon — Three Real-World Examples
Zealots
Entitlement BS
Agenderle
Mutations
Einstein’s Error — The Confusion of Laws With Their Effects
The Museum Is the Art
Polly Sooth the Air Rage
The Truth
The Darkness
Morality = STDs?
Fulfilling the Moral Duty To Disdain
MustWinForSure
Choice
Real Design
The Two Rules of Great Programming
Cynicism
The End of the Nerds
Poverty — Humanity’s Damage Control
Berners-Lee’s Rating System = Google
The Secret Anti-MP3 Trick In “Independent Women” and “You Sang To Me”
ID and the Large Hadron Collider Scare
Not A Bluff
The Fall of Microsoft
Life Sucks When You’re Not Winning
Aware
The Old-Fashioned Way
The Old People Who Pop Into Existence
Theodicy — A Big Stack of Papers
The Designed, Cause-and-Effect Brain
Mosaics
IC Counterarguments
The Capitalist’s Imaginary Line
Education Isn’t Everything
I Don’t Know
Funny iPhone Party-Poopers
Avoiding Conflict At All Costs
Behavior and Free Will, Unconfused
“Reduced To” Absurdum
Suzie and Bubba Redneck — the Carriers of Intelligence
Everything You Need To Know About Haldane’s Dilemma
Darwin + Hitler = Baloney
Meta-ware
Designed For Combat
Speed Racer R Us
Bold — Uh-huh
Conscious of Consciousness
Future Perfect
Where Real and Yahoo Went Wrong
The Purpose of Surface
Eradicating Religion Won’t Eradicate War
Documentation Overkill
A Tale of Two Movies
The Changing Face of Sam Adams
Dinesh D’Souza On ID
Why Quintic (and Higher) Polynomials Have No Algebraic Solution
Translation of Paul Graham’s Footnote To Plain English
What Happened To Moore’s Law?
Goldston On ID
The End of Martial Law
The Two Faces of Evolution
A Fine Recommendation
Free Will and Population Statistics
Dennett/D’Souza Debate — D’Souza
Dennett/D’Souza Debate — Dennett
The Non-Euclidean Geometry That Wasn’t There
Defective Attitude Towards Suburbia
The Twin Deficit Phantoms
Sleep Sync and Vertical Hold
More FUD In Your Eye
The Myth of Rubbernecking
Keeping Intelligent Design Honest
Failure of the Amiga — Not Just Mismanagement
Maxwell’s Silver Hammer = Be My Honey Do?
End Unsecured Debt
The Digits of Pi Cannot Be Sequentially Generated By A Computer Program
Faster Is Better
Goals Can’t Be Avoided
Propped-Up Products
Ignoring ID Won’t Work
The Crabs and the Bucket
Communism As A Side Effect of the Transition To Capitalism
Google and Wikipedia, Revisited
National Geographic’s Obesity BS
Cavemen
Theodicy Is For Losers
Seattle Redux
Quitting
Living Well
A Memory of Gateway
Is Apple’s Font Rendering Really Non-Pixel-Aware?
Humans Are Complexity, Not Choice
A Subtle Shift
Moralism — The Emperor’s New Success
Code Is Our Friend
The Edge of Religion
The Dark Side of Pixel-Aware Font Rendering
The Futility of DVD Encryption
ID Isn’t About Size or Speed
Blood-Curdling Screams
ID Venn Diagram
Rich and Good-Looking? Why Libertarianism Goes Nowhere
FUV — Fear, Uncertainty, and Vista
Malware Isn’t About Total Control
Howard = Second Coming?
Doomsday? Or Just Another Sunday
The Real Function of Wikipedia In A Google World
Objective-C Philosophy
Clarity From Cisco
2007 Macworld Keynote Prediction
FUZ — Fear, Uncertainty, and Zune
No Fear — The Most Important Thing About Intelligent Design
How About A Rational Theodicy
Napster and the Subscription Model
Intelligent Design — Introduction
The One Feature I Want To See In Apple’s Safari.