Dishonesty For the Greater Good

2010.11.13   prev     next

FROM Jonah Lehrer’s “Beware Our Blind Seers” (The Wall Street Journal):

[Pundits] sound as if they know what they’re talking about.

But do they? Philip Tetlock, a psychologist at the University of California, Berkeley, has spent 25 years trying to find out. ...

By the end of the study, Mr. Tetlock had quantified 82,361 predictions.

How did the experts do? When it came to predicting the likelihood of an outcome, the vast majority performed worse than random chance.

How could pundits be worse than random guessing? Lehrer’s article cites “overconfidence,” “confirmation bias,” and “preconceptions” as the explanation.

That seems a little too vague to me. Actually, now that I think about it some more, it seems impossible. How can overconfidence make you worse than random guessing? It can’t. Same with confirmation bias, or preconceptions. Any flaw in your ability to predict the future could make your predictions, on average, worse than if you didn’t have that flaw. But not worse than random guessing. The accuracy of random guessing is the absolute bottom, below which you cannot go, no matter how bad your predictive flaws may be.

So how did Tetlock get these results? Here’s my theory:

Pundits, like everyone else, have preferences of what they would like to see happen. When pundits sense that there’s a good chance that their preferred outcome will not be realized, they feel a more urgent need to persuade others that it will be. This is especially true if the outcome is determined by some sort of popular consensus, like voting in an election, or buying or selling stock in a company, or choosing which company’s products to buy — then the pundits feel they must use their influence to push the outcome in the direction they want it to fall.

Of course, few, if any, pundits have enough influence to actually prevent the outcome from falling in their non-preferred direction, so that’s what it does. And then you can chalk up another incorrect prediction.

When an outcome seems likely to go the way pundits want it to, they feel little need to push it in that direction, and so are less likely to speak out on that subject.

Pundits are actually better than chance at knowing what’s likely to happen. They appear to be worse than chance because they aren’t trying to achieve accuracy in predicting trends — instead they’re trying to use their public predictions to push against trends they can see coming, and don’t like. Overconfidence, confirmation bias, preconceptions, and all other flaws in pundits’ ability to predict the future, can only drive them down to the accuracy of random guessing. To go below that, it takes real predictive ability plus intentional dishonesty.

Capitalism

Capitalism makes a nation stronger. It makes a nation that is more easily able to fend off attacks from other nations, and that is more able to take over other nations, should it decide that it’s in its best interest to do so.

But that’s all capitalism does. Capitalism does not make people’s lives better. There are lots of people whose lives are miserable under capitalism, and the capitalists have a funny answer to that. Capitalists almost never argue in favor of capitalism on the basis of national strength or longevity or power over other nations. They almost always argue in favor of capitalism on the basis that it makes our lives better. But then when you start talking about how so many people in capitalism are extremely miserable, unhappy with their situation, with what they’re able to get under capitalism, then the capitalists have a very funny answer, and that answer is that those people aren’t supposed to be unhappy. That they’re getting exactly what they deserve, exactly what they legitimately should, as per the rules of capitalism. And that they have no right to be unhappy about that. And if they are unhappy about that, then it’s their own fault, and they deserve that unhappiness until they decide to stop feeling that way. The capitalists don’t come out and say it that bluntly, but that’s what they mean.

And this is very strange because, of course, on the one hand the capitalists are trying to say that capitalism achieves a better result, but on the other hand they dismiss any flaws in that result by simply saying that those flaws are not flaws. That when people are unhappy under capitalism, it’s a legitimate unhappiness, it’s an unhappiness they’re supposed to feel. Until they decide not to feel that way.

But what about the Soviet Union, and how much worse living conditions were there than in the USA? Doesn’t that prove capitalism makes our lives better? Wouldn’t someone who was transported from the USSR to the USA be overjoyed at their better quality of life, or traumatized if transported in the opposite direction?

Not exactly. What percentage of the USSR’s population was transported to the USA as described above? Nearly 0%. How many in the opposite direction? Nearly 0%. It’s a fantasy scenario that virtually never happened. How would a person from five hundred years ago feel about their material possessions and opportunities if transported to the present? Overjoyed, perhaps. How would a present-day person feel about their possessions and opportunities if transported to five hundred years ago? Horrified, most likely.

So were people profoundly more miserable and dissatisfied five hundred years ago than they are today? Not as far as we can tell, no. Are we all satisfied and happy with our lives because we have more possessions and opportunities than people did five hundred years ago? Hardly.

Hmmm — the USSR crumbled, didn’t it? Doesn’t that count for something? It sure does. National strength and power.

There isn’t any non-circular way to justify capitalism except on national strength; the ability to fend off and/or take over other nations.

Now, capitalists generally don’t defend it that way. Why not? Well, for one, they might be repulsed by that reality. They want to believe that capitalism yields something better. But then there’s an even more important reason, and that is that they’re trying to encourage people to vote capitalist. And you can’t encourage people to vote capitalist by talking about national strength or the ability to fend off attacks, or anything like that. You have to make people think that their lives are going to be personally better.

If people don’t think their lives are going to be better, then they’re not going to vote that way. And so unless our country is under imminent threat of attack by some very powerful aggressor nation — which, ever since the fall of the USSR, it isn’t; even 9/11 was a drop in the bucket compared to World War II — then you have to ask, how do you convince people to vote for capitalism? Not by telling them they’re going to be miserable but safe. No, you convince them to vote for capitalism by telling them that they will be happier under capitalism. And by telling them that those who say they’re unhappy under capitalism are just malicious. That they shouldn’t feel that way, or that they’re lying, or that they’re telling the truth but their misery is self-created, because they ought to be happy with what they have.

Capitalists have to come up with an argument that has a decent chance of persuading people to vote capitalist, and that’s what they’re trying to do. They’re not really trying to tell the truth about capitalism — I’m telling you the truth about capitalism right here. Capitalists want capitalism. They don’t want to tell the truth that might or might not cause people to vote capitalist.

Religion and Darwinism

It’s kind-of the same thing with religion. If you believe people’s lives will be better with religion, you have to choose a specific religion and promote it exclusively. You can’t go around saying, “Join one of the major religions; your life will be better!” because that’s saying, in effect, that religions are myths; falsehoods.

And Darwinists too: There are so many people — intelligent and educated — who, when asked, “Do you believe that random mutation and natural selection produced life’s adaptive complexity that we see on Earth today?” think that they’re really being asked, “Do you believe in freedom, democracy, technology, and scientific progress?” (As opposed to theocracy, dictatorship, 1984, etc.) And so they answer accordingly.

And it’s even worse than that. If they’re asked the question in a more specific way, like, “Do you really believe that there’s strong evidence that random mutation and natural selection can do this? You’re not just saying they can because you want to promote freedom, democracy, etc.?” then they think even more that they’re being asked if they believe in freedom, democracy, etc., and so they answer even more vociferously that yes, yes, random mutation and natural selection definitely can do this, and that’s really why I’m saying they can; because they can, and did.

It’s a situation where the belief that we’re going to achieve a certain goal in society totally overwhelms the ability to speak honestly about a subject, or even the desire to.

 

Update 2011.04.01 — added “Actually, now ... these results?” and “Overconfidence, confirmation ... below that.”

 

See also:
iPhone Party-Poopers Redux
&
Silly iPad Spoilsports

 

prev     next

 

 

Hear, hear

prev     next

Best recent articles

Make Your Own FBI Backdoor, Right Now

Polygon Triangulation With Hole

The Legacy of Windows Phone

Palm Fan

Vivek Wadhwa, Scamster Bitcoin Doomsayer

Fanboy Features (regularly updated)

When Starting A Game of Chicken With Apple, Expect To Lose — hilarious history of people who thought they could bluff Apple into doing whatever they wanted.

A Memory of Gateway — news chronology of Apple’s ascendancy to the top of the technology mountain.

iPhone Party-Poopers Redux and Silly iPad Spoilsports — amusing litanies of industry pundits desperately hoping iPhone and iPad will go away and die.

Embittered Anti-Apple Belligerents — general anger at Apple’s gi-normous success.

RSS FEED

My books

Now available on Apple Books!

   

Links

Daring Fireball

The Loop

RoughlyDrafted

Macalope

Red Meat

Despair, Inc.

Real Solution #9 (Mambo Mania Mix) over stock nuke tests. (OK, somebody made them rip out the music — try this instead.)

Ernie & Bert In Casino

Great Explanation of Star Wars

Best commercials (IMO) from Super Bowl 41, 43, 45, 46, 47, 53 and 55

Kirk & Spock get Closer

American football explained.

TV: Severance; Succession; The Unlikely Murderer; Survivor; The Jinx; Breaking Bad; Inside Amy Schumer

God’s kitchen

Celebrity Death Beeper — news you can use.

Making things for the web.

RedQueenCoder.

My vote for best commercial ever. (But this one’s a close second, and I love this one too.)

Recent commercials I admire: KFC, Audi, Volvo

Best reggae song I’ve discovered in quite a while: Virgin Islands Nice

d120 dice: You too (like me) can be the ultimate dice nerd.

WiFi problems? I didn’t know just how bad my WiFi was until I got eero.

Favorite local pad thai: Pho Asian Noodle on Lane Ave. Yes, that place; blame Taco Bell for the amenities. Use the lime, chopsticks, and sriracha. Yummm.

Um, could there something wrong with me if I like this? Or this?

This entire site as a zip file — last updated 2024.08.16

Previous articles

Fitness Startup Is Hard

Sweeney Translation

Collatz, Revisited

Downtown Isn’t Coming Back

Stig

Gaston

Nuclear War

Wolfspeare

Engström’s Motive

Google’s Decision

Warrening

The Two Envelopes Problem, Solved

The Practical Smartphone Buyer

Would Apple Actually Exit the EU Or UK?

See You Looked

Blackjack Strategy Card (Printable)

Swan Device 1956 — Probable Shape

Pu

RGB-To-Hue Conversion

Polygon Triangulation With Hole

One-Point Implosion: “Palm Fan”

Implosion: Were Those Two-Speed Lenses Really Necessary?

Apple Wants User/Developer Choice; Its Enemies Want Apple Ruin

Tim Sweeney Plays Dumb

The Jury of One

The Lesson of January 6

Amnesia Is Not A Good Plot

I Was Eating for 300 lbs, Not 220

Action Arcade Sounds and Reality

The Flea Market and the Retail Store

Squaring the Impossible

Yes, Crocodiles Are Dinosaurs — Duh

Broccoli and Apples Are Not the Antidote To Donuts and Potato Chips

Cydia and “Competition”

The Gift of Nukes

Prager University and the Anti-Socialists’ Big Blind Spot

In Defense of Apple’s 30% Markup, Part 2

In Defense of Apple’s 30% Markup

Make Your Own FBI Backdoor, Right Now

Storm

The Legacy of Windows Phone

Mindless Monsters

To the Bitter End

“Future Shock” Shock

Little Plutonium Boy

The iPhone Backdoor Already Exists

The Impulse To Be Lazy

HBO’s “Meth Storm” BS

Judos vs. Pin Place

Vizio M-Series 65" LCD (“LED”) TV — Best Settings (IMHO)

Tasting Vegemite (Bucket List)

The IHOP Coast

The Surprise Quiz Paradox, Solved

Apple, Amazon, Products, and Services — Not Even Close

Nader’s Open Blather

Health — All Or Nothing?

Vivek Wadhwa, Scamster Bitcoin Doomsayer

Backwards Eye Wiring — the Optical Focus Hypothesis

Apple’s Cash Is Not the Key

Nothing More Angry Than A Cornered Anti-Apple

Let ’Em Glow

The Ultimate, Simple, Fair Tax

Compassion and Vision

When Starting A Game of Chicken With Apple, Expect To Lose

The Caveat

Superb Owl

NavStar

Basic Reproduction Number

iBook Price-Fixing Lawsuit Redux — Apple Won

Delusion Made By Google

Religion Is A Wall

It’s Not A Criticism, It’s A Fact

Michigan Wolverines 2014 Football Season In Review

Sprinkler Shopping

Why There’s No MagSafe On the New MacBook

Sundar Pichai Says Devices Will Fade Away

The Question Every Apple Naysayer Must Answer

Apple’s Move To TSMC Is Fine For Apple, Bad For Samsung

Method of Implementing A Secure Backdoor In Mobile Devices

How I Clip My Cat’s Nails

Die Trying

Merger Hindsight

Human Life Decades

Fire and the Wheel — Not Good Examples of A Broken Patent System

Nobody Wants Public Transportation

Seasons By Temperature, Not Solstice

Ode To Coffee

Starting Over

FaceBook Messenger — Why I Don’t Use It

Happy Birthday, Anton Leeuwenhoek

Standard Deviation Defined

Not Hypocrisy

Simple Guide To Progress Bar Correctness

A Secure Backdoor Is Feasible

Don’t Blink

Predictive Value

Answering the Toughest Question About Disruption Theory

SSD TRIM Command In A Nutshell

The Enderle Grope

Aha! A New Way To Screw Apple

Champagne, By Any Other Maker

iOS Jailbreaking — A Perhaps-Biased Assessment

Embittered Anti-Apple Belligerents

Before 2001, After 2001

What A Difference Six Years Doesn’t Make

Stupefying New Year’s Stupidity

The Innovator’s Victory

The Cult of Free

Fitness — The Ultimate Transparency

Millions of Strange Devotees and Fanatics

Remember the iPod Killers?

Theory As Simulation

Four Analysts

What Was Christensen Thinking?

The Grass Is Always Greener — Viewing Angle

Is Using Your Own Patent Still Allowed?

The Upside-Down Tech Future

Motive of the Anti-Apple Pundit

Cheating Like A Human

Disremembering Microsoft

Security-Through-Obscurity Redux — The Best of Both Worlds

iPhone 2013 Score Card

Dominant and Recessive Traits, Demystified

Yes, You Do Have To Be the Best

The United States of Texas

Vertical Disintegration

He’s No Jobs — Fire Him

A Players

McEnroe, Not Borg, Had Class

Conflict Fades Away

Four-Color Theorem Analysis — Rules To Limit the Problem

The Unusual Monopolist

Reasonable Projection

Five Times What They Paid For It

Bypassable Security Certificates Are Useless

I’d Give My Right Arm To Go To Mars

Free Advice About Apple’s iOS App Store Guidelines

Inciting Violence

One Platform

Understanding IDC’s Tablet Market Share Graph

I Vote Socialist Because...

That Person

Product Naming — Google Is the Other Microsoft

Antecessor Hypotheticum

Apple Paves the Way For Apple

Why — A Poem

App Anger — the Supersized-Mastodon-In-the-Room That Marco Arment Doesn’t See

Apple’s Graphic Failure

Why Microsoft Copies Apple (and Google)

Coders Code, Bosses Boss

Droidfood For Thought

Investment Is Not A Sure Thing

Exercise is Two Thirds of Everything

Dan “Real Enderle” Lyons

Fairness

Ignoring the iPod touch

Manual Intervention Should Never Make A Computer Faster

Predictions ’13

Paperless

Zeroth — Why the Century Number Is One More Than the Year Number

Longer Than It Seems

Partners: Believe In Apple

Gun Control: Best Arguments

John C. Dvorak — Translation To English

Destructive Youth

Wiens’s Whine

Free Will — The Grand Equivocation

What Windows-vs.-Mac Actually Proved

A Tale of Two Logos

Microsoft’s Three Paths

Amazon Won’t Be A Big Winner In the DOJ’s Price-Fixing Suit

Infinite Sets, Infinite Authority

Strategy Analytics and Long Term Accountability

The Third Stage of Computing

Why 1 Isn’t Prime, 2 Is Prime, and 2 Is the Only Even Prime

Readability BS

Lie Detection and Psychos

Liking

Steps

Microsoft’s Dim Prospects

Humanity — Just Barely

Hanke-Henry Calendar Won’t Be Adopted

Collatz Conjecture Analysis (But No Proof; Sorry)

Rock-Solid iOS App Stability

Microsoft’s Uncreative Character

Microsoft’s Alternate Reality Bubble

Microsoft’s Three Ruts

Society’s Fascination With Mass Murder

PlaysForSure and Wikipedia — Revisionism At Its Finest

Procrastination

Patent Reform?

How Many Licks

Microsoft’s Incredible Run

Voting Socialist

Darwin Saves

The Size of Things In the Universe

The Self-Fulfilling Prophecy That Wasn’t

Fun

Nobody Was In Love With Windows

Apples To Apples — How Anti-Apple Pundits Shoot Themselves In the Foot

No Holds Barred

Betting Against Humanity

Apple’s Premium Features Are Free

Why So Many Computer Guys Hate Apple

3D TV With No Glasses and No Parallax/Focus Issues

Waves With Particle-Like Properties

Gridlock Is Just Fine

Sex Is A Fantasy

Major Player

Why the iPad Wannabes Will Definitely Flop

Predators and Parasites

Prison Is For Lotto Losers

The False Dichotomy

Wait and See — Windows-vs-Mac Will Repeat Itself

Dishonesty For the Greater Good

Barr Part 2

Enough Information

Zune Is For Apple Haters

Good Open, Bad Open

Beach Bodies — Who’s Really Shallow?

Upgrade? Maybe Not

Eliminating the Impossible

Selfish Desires

Farewell, Pirate Cachet

The Two Risk-Takers

Number of Companies — the Idiocy That Never Dies

Holding On To the Solution

Apple Religion

Long-Term Planning

What You Have To Give Up

The End of Elitism

Good and Evil

Life

How Religion Distorts Science

Laziness and Creativity

Sideloading and the Supersized-Mastodon-In-the-Room That Snell Doesn’t See

Long-Term Self-Delusion

App Store Success Won’t Translate To Books, Movies, and Shows

Silly iPad Spoilsports

I Disagree

Five Rational Counterarguments

Majority Report

Simply Unjust

Zooman Science

Reaganomics — Like A Diet — Works

Free R&D?

Apple’s On the Right Track

Mountains of Evidence

What We Do

Hope Conquers All

Humans Are Special — Just Not That Special

Life = Survival of the Fittest

Excuse Me, We’re Going To Build On Your Property

No Trademark iWorries

Knowing

Twisted Excuses

The Fall of Google

Real Painters

The Meaning of Kicking Ass

How To Really Stop Casual Movie Disc Ripping

The Solitary Path of the High-Talent Programmer

Fixing, Not Preaching

Why Blackmail Is Still Illegal

Designers Cannot Do Anything Imaginable

Wise Dr. Drew

Rats In A Too-Small Cage

Coming To Reason

Everything Isn’t Moving To the Web

Pragmatics, Not Rights

Grey Zone

Methodologically Dogmatic

The Purpose of Language

The Punishment Defines the Crime

Two Many Cooks

Pragmatism

One Last Splurge

Making Money

What Heaven and Hell Are Really About

America — The Last Suburb

Hoarding

What the Cloud Isn’t For

Diminishing Returns

What You’re Seeing

What My Life Needs To Be

Taking An Early Retirement

Office Buildings

A, B, C, D, Pointless Relativity

Stephen Meyer and Michael Medved — Where Is ID Going?

If You Didn’t Vote — Complain Away

iPhone Party-Poopers Redux

What Free Will Is Really About

Spectacularly Well

Pointless Wrappers

PTED — The P Is Silent

Out of Sync

Stupid Stickers

Security Through Normalcy

The Case For Corporate Bonuses

Movie Copyrights Are Forever

Permitted By Whom?

Quantum Cognition and Other Hogwash

The Problem With Message Theory

Bell’s Boring Inequality and the Insanity of the Gaps

Paying the Rent At the 6 Park Avenue Apartments

Primary + Reviewer — An Alternative IT Plan For Corporations

Yes Yes Yes

Feelings

Hey Hey Whine Whine

Microsoft About Microsoft Visual Microsoft Studio Microsoft

Hidden Purple Tiger

Forest Fair Mall and the Second Lamborghini

Intelligent Design — The Straight Dope

Maxwell’s Demon — Three Real-World Examples

Zealots

Entitlement BS

Agenderle

Mutations

Einstein’s Error — The Confusion of Laws With Their Effects

The Museum Is the Art

Polly Sooth the Air Rage

The Truth

The Darkness

Morality = STDs?

Fulfilling the Moral Duty To Disdain

MustWinForSure

Choice

Real Design

The Two Rules of Great Programming

Cynicism

The End of the Nerds

Poverty — Humanity’s Damage Control

Berners-Lee’s Rating System = Google

The Secret Anti-MP3 Trick In “Independent Women” and “You Sang To Me”

ID and the Large Hadron Collider Scare

Not A Bluff

The Fall of Microsoft

Life Sucks When You’re Not Winning

Aware

The Old-Fashioned Way

The Old People Who Pop Into Existence

Theodicy — A Big Stack of Papers

The Designed, Cause-and-Effect Brain

Mosaics

IC Counterarguments

The Capitalist’s Imaginary Line

Education Isn’t Everything

I Don’t Know

Funny iPhone Party-Poopers

Avoiding Conflict At All Costs

Behavior and Free Will, Unconfused

“Reduced To” Absurdum

Suzie and Bubba Redneck — the Carriers of Intelligence

Everything You Need To Know About Haldane’s Dilemma

Darwin + Hitler = Baloney

Meta-ware

Designed For Combat

Speed Racer R Us

Bold — Uh-huh

Conscious of Consciousness

Future Perfect

Where Real and Yahoo Went Wrong

The Purpose of Surface

Eradicating Religion Won’t Eradicate War

Documentation Overkill

A Tale of Two Movies

The Changing Face of Sam Adams

Dinesh D’Souza On ID

Why Quintic (and Higher) Polynomials Have No Algebraic Solution

Translation of Paul Graham’s Footnote To Plain English

What Happened To Moore’s Law?

Goldston On ID

The End of Martial Law

The Two Faces of Evolution

A Fine Recommendation

Free Will and Population Statistics

Dennett/D’Souza Debate — D’Souza

Dennett/D’Souza Debate — Dennett

The Non-Euclidean Geometry That Wasn’t There

Defective Attitude Towards Suburbia

The Twin Deficit Phantoms

Sleep Sync and Vertical Hold

More FUD In Your Eye

The Myth of Rubbernecking

Keeping Intelligent Design Honest

Failure of the Amiga — Not Just Mismanagement

Maxwell’s Silver Hammer = Be My Honey Do?

End Unsecured Debt

The Digits of Pi Cannot Be Sequentially Generated By A Computer Program

Faster Is Better

Goals Can’t Be Avoided

Propped-Up Products

Ignoring ID Won’t Work

The Crabs and the Bucket

Communism As A Side Effect of the Transition To Capitalism

Google and Wikipedia, Revisited

National Geographic’s Obesity BS

Cavemen

Theodicy Is For Losers

Seattle Redux

Quitting

Living Well

A Memory of Gateway

Is Apple’s Font Rendering Really Non-Pixel-Aware?

Humans Are Complexity, Not Choice

A Subtle Shift

Moralism — The Emperor’s New Success

Code Is Our Friend

The Edge of Religion

The Dark Side of Pixel-Aware Font Rendering

The Futility of DVD Encryption

ID Isn’t About Size or Speed

Blood-Curdling Screams

ID Venn Diagram

Rich and Good-Looking? Why Libertarianism Goes Nowhere

FUV — Fear, Uncertainty, and Vista

Malware Isn’t About Total Control

Howard = Second Coming?

Doomsday? Or Just Another Sunday

The Real Function of Wikipedia In A Google World

Objective-C Philosophy

Clarity From Cisco

2007 Macworld Keynote Prediction

FUZ — Fear, Uncertainty, and Zune

No Fear — The Most Important Thing About Intelligent Design

How About A Rational Theodicy

Napster and the Subscription Model

Intelligent Design — Introduction

The One Feature I Want To See In Apple’s Safari.