Sep 24 2025

When AI Hype Weakens Society: Lessons from Karen Hao

Category: AI,AI Governance,Information Security,ISO 42001disc7 @ 12:23 pm

Karen Hao’s Empire of AI provides a critical lens on the current AI landscape, questioning what intelligence truly means in these systems. Hao explores how AI is often framed as an extraordinary form of intelligence, yet in reality, it remains highly dependent on the data it is trained on and the design choices of its creators.

She highlights the ways companies encourage users to adopt AI tools, not purely for utility, but to collect massive amounts of data that can later be monetized. This approach, she argues, blurs the line between technological progress and corporate profit motives.

According to Hao, the AI industry often distorts reality. She describes AI as overhyped, framing the movement almost as a quasi-religious phenomenon. This hype, she suggests, fuels unrealistic expectations both among developers and the public.

Within the AI discourse, two camps emerge: the “boomers” and the “doomers.” Boomers herald AI as a new form of superior intelligence that can solve all problems, while doomers warn that this same intelligence could ultimately be catastrophic. Both, Hao argues, exaggerate what AI can actually do.

Prominent figures sometimes claim that AI possesses “PhD-level” intelligence, capable of performing complex, expert-level tasks. In practice, AI systems often succeed or fail depending on the quality of the data they consume—a vulnerability when that data includes errors or misinformation.

Hao emphasizes that the hype around AI is driven by money and venture capital, not by a transformation of the economy. According to her, Silicon Valley’s culture thrives on exaggeration: bigger models, more data, and larger data centers are marketed as revolutionary, but these features alone do not guarantee real-world impact.

She also notes that technology is not omnipotent. AI is not independently replacing jobs; company executives make staffing decisions. As people recognize the limits of AI, they can make more informed, “intelligent” choices themselves, countering some of the fears and promises surrounding automation.

OpenAI exemplifies these tensions. Founded as a nonprofit intended to counter Silicon Valley’s profit-driven AI development, it quickly pivoted toward a capitalistic model. Today, OpenAI is valued around $300–400 billion, and its focus is on data and computing power rather than purely public benefit, reflecting the broader financial incentives in the AI ecosystem.

Hao likens the AI industry to 18th-century colonialism: labor exploitation, monopolization of energy resources, and accumulation of knowledge and talent in wealthier nations echo historical imperial practices. This highlights that AI’s growth has social, economic, and ethical consequences far beyond mere technological achievement.

Hao’s analysis shows that AI, while powerful, is far from omnipotent. The overhype and marketing-driven narrative can weaken society by creating unrealistic expectations, concentrating wealth and power in the hands of a few corporations, and masking the social and ethical costs of these technologies. Instead of empowering people, it can distort labor markets, erode worker rights, and foster dependence on systems whose decision-making processes are opaque. A society that uncritically embraces AI risks being shaped more by financial incentives than by human-centered needs.

Today’s AI can perform impressive feats—from coding and creating images to diagnosing diseases and simulating human conversation. While these capabilities offer huge benefits, AI could be misused, from autonomous weapons to tools that spread misinformation and destabilize societies. Experts like Elon Musk and Geoffrey Hinton echo these concerns, advocating for regulations to keep AI safely under human control.

Empire of AI: Dreams and Nightmares in Sam Altman’s OpenAI

Letters and Politics Mitch Jeserich interview Karen Hao 09/24/25

Generative AI is a “remarkable con” and “the perfect nihilistic form of tech bubbles”Ed Zitron

AI Darwin Awards Show AI’s Biggest Problem Is Human

DISC InfoSec’s earlier posts on the AI topic

AIMS ISO42001 Data governance

AI is Powerful—But Risky. ISO/IEC 42001 Can Help You Govern It

Secure Your Business. Simplify Compliance. Gain Peace of Mind

InfoSec services | InfoSec books | Follow our blog | DISC llc is listed on The vCISO Directory | ISO 27k Chat bot | Comprehensive vCISO Services | ISMS Services | Security Risk Assessment Services | Mergers and Acquisition Security

Tags: AI Hype Weakens Society, Empire of AI, Karen Hao