L1
Β·
Quiz
Β·
Lab
L2
Β·
Quiz
Β·
Lab
L3
Β·
Quiz
Β·
Lab
L4
Β·
Quiz
Β·
Lab
Module Test
Module 3 Β· Lesson 1

The Variable Reward Machine

How AI systems learned the oldest trick in the gambler's playbook β€” and scaled it to billions of users.
Why does one more scroll always feel justified?

B.J. Fogg's Persuasive Technology Lab at Stanford had spent years mapping how computers could change human behavior. By 2007, former students were leaving not for academia but for Facebook, Google, and Twitter β€” taking Fogg's behavior-change frameworks directly into product design. The lab's "captology" research, originally aimed at health behavior change, became the blueprint for engagement engineering at the world's most visited websites.

The Skinner Box Goes Digital

In the 1950s, B.F. Skinner demonstrated that variable-ratio reinforcement β€” rewards delivered unpredictably β€” produced the most persistent and compulsive behavior in animals. A rat pressing a lever that sometimes, randomly, dispenses a pellet will press far more frantically than one receiving a pellet every single time. The behavior is nearly impossible to extinguish.

The infinite scroll, pioneered by Aza Raskin at Humanized in 2006 and rapidly adopted across social platforms, is a direct technological implementation of this principle. Each swipe downward is a lever pull. Sometimes the next post is boring; sometimes it's something that makes you laugh, feel outrage, or discover something genuinely useful. The unpredictability is not a bug. It is the mechanism.

Raskin himself publicly regretted the invention in a 2018 BBC interview, estimating it costs humanity approximately 600,000 hours of attention per day on social media alone.

Key Mechanism

Variable-ratio reinforcement schedules generate the highest and most stable rates of responding across all animal species tested β€” including humans. Unlike fixed schedules, they create behavior that is highly resistant to extinction because the subject never knows when the next reward is coming.

Notification Engineering

In 2017, former Google design ethicist Tristan Harris testified before the U.S. Senate that technology platforms deliberately engineer their notification systems to maximize psychological impact. Internal documents from Meta (then Facebook) obtained by The Wall Street Journal in 2021 confirmed that the company's own researchers had identified Instagram's recommendation algorithms as worsening body image issues in teenagers β€” but growth metrics took precedence over this research.

The notification itself functions as a conditioned stimulus. The red badge on an app icon triggers a mild anxiety response in habituated users β€” the same neural pathway activated by hunger. Checking the notification relieves the anxiety momentarily. The relief is the reward. The cycle repeats dozens of times daily.

LinkedIn's engineering team published a 2018 blog post describing deliberate "batching" of notifications to be sent at times most likely to generate re-engagement, an admission that notification timing is optimized not for user convenience but for platform return visits.

Variable-Ratio Schedule A reinforcement pattern where rewards appear after an unpredictable number of responses, producing the most compulsive and extinction-resistant behavior known to behavioral science.
Intermittent Reinforcement Any pattern where rewards are delivered inconsistently. The uncertainty itself becomes arousing, increasing engagement more than reliable reward delivery.
Behavioral Loop The trigger β†’ action β†’ reward cycle that AI systems optimize to keep users returning. The loop is tightened through A/B testing millions of variations until the most compelling version is deployed at scale.

The AI Amplification Layer

Early social media used simple chronological feeds β€” the variable reward existed but was partly natural. The transformation occurred when algorithmic ranking replaced chronology. Facebook replaced its chronological feed with algorithmic ranking in 2009. Twitter introduced its algorithm in 2016. YouTube's recommendation engine, documented in internal research leaked to MIT Technology Review in 2019, was found to systematically push users toward progressively more extreme content because extremity drove watch time.

The AI layer does not introduce variable reward β€” it optimizes variable reward. Machine learning models trained on engagement data discover, without being explicitly programmed to, that unpredictability, emotional provocation, and social comparison are reliable engagement drivers. The system learns to deploy these psychological levers because they work, not because any engineer consciously designed them in.

This is a crucial distinction: the addictive properties of modern AI-powered feeds are often emergent rather than intentional β€” which makes them harder to regulate and harder to reverse.

Historical Anchor

The 2018 Facebook internal study "Well-Being" β€” portions of which were disclosed in court filings in 2023 as part of the Meta youth addiction litigation β€” found that heavy Facebook use was correlated with reduced well-being across 82% of measured outcomes. The study was not published. It was circulated internally and then shelved.

Lesson 1 Quiz

The Variable Reward Machine β€” test your understanding
1. Which reinforcement schedule produces the most persistent and compulsion-resistant behavior?
Correct. Variable-ratio schedules β€” rewards after unpredictable numbers of responses β€” produce the most compulsive and extinction-resistant behavior. This is why slot machines and social media feeds are structurally similar.
Not quite. Variable-ratio schedules produce the most persistent behavior because the unpredictability itself is arousing and prevents the subject from ever concluding that rewards have stopped coming.
2. Aza Raskin, who invented infinite scroll, publicly estimated it costs humanity approximately how much collective attention per day?
Correct. In his 2018 BBC interview, Raskin estimated infinite scroll costs roughly 600,000 hours of human attention daily across social platforms β€” and expressed regret for the invention.
The figure Raskin cited in his 2018 BBC interview was 600,000 hours of attention lost per day across social media platforms globally.
3. When Facebook replaced its chronological feed with algorithmic ranking in 2009, the primary effect on addictive design was:
Correct. Variable reward existed in chronological feeds too β€” it was just natural. Algorithmic ranking added an optimization layer: the AI learns which content patterns maximize engagement and surfaces more of them, amplifying existing addictive dynamics.
Variable reward existed even in chronological feeds. The algorithmic shift allowed machine learning to actively optimize that variability β€” learning which emotional triggers, content types, and timing patterns maximize compulsive return.
4. According to the lesson, the addictive properties of AI-powered recommendation feeds are often described as:
Correct. This emergent quality makes addictive AI design especially difficult to address: no single engineer decided to make it addictive. The system learned, through training on engagement data, that psychological manipulation drives metrics β€” without anyone explicitly programming that goal.
The lesson distinguishes emergent addictive properties β€” discovered by ML optimization β€” from intentional design. The distinction matters because emergent harms are harder to assign responsibility for and harder to regulate.

Lab 1: Identifying Behavioral Loops

Analyze real platform mechanics through the lens of variable reinforcement theory

Your Task

You've learned how AI systems implement variable-ratio reinforcement at scale. In this lab, you'll analyze specific platform mechanics with your AI lab assistant. Describe a feature of any app or platform you use, and the assistant will help you identify which behavioral psychology principles it exploits, what the reward structure looks like, and whether it's emergent or intentional.

Try: "Analyze the pull-to-refresh mechanic on Twitter/X" or "Why does TikTok's For You page feel impossible to stop scrolling?" or "Break down how Snapchat streaks work psychologically."
Behavioral Loop Analyzer
Lab 1
Welcome to Lab 1. I'm here to help you dissect the behavioral psychology baked into the platforms you use every day. Describe any app feature, notification pattern, or design element β€” and we'll map it to the reinforcement mechanisms covered in Lesson 1. What would you like to analyze?
Module 3 Β· Lesson 2

The Dopamine Economy

What neuroscience says about AI-induced reward cycles β€” and why "likes" were engineered to be addictive.
Is social media addiction neurologically real, or just a metaphor?

When Justin Rosenstein and Leah Pearlman designed the Facebook Like button in 2009, their stated goal was to spread positivity across the platform. Within months, internal data showed something else: users were checking their posts compulsively to watch like counts climb. Rosenstein later told The Guardian in 2017 that he now uses an iPhone with parental controls β€” installed by an assistant β€” specifically to limit his own access to social apps. Pearlman hired a social media manager to handle her own social media presence so she wouldn't have to engage with it directly.

Two of the Like button's own creators found it necessary to engineer barriers against their own invention.

What Dopamine Actually Does

Popular coverage of social media addiction frequently mischaracterizes dopamine. Dopamine is not a "pleasure chemical" β€” it is primarily a prediction and anticipation signal. Dopamine neurons fire most strongly not when a reward arrives, but when a reward is anticipated or when an unexpected reward appears. When expected rewards fail to appear, dopamine levels drop below baseline β€” producing a discomfort that motivates renewed seeking behavior.

This is precisely why checking your phone when no notification has appeared still feels compelled: the possibility of a reward triggers the anticipatory dopamine response. The checking behavior is not seeking a reward already received β€” it is seeking the possibility of one.

Neuroscientist Kent Berridge at the University of Michigan distinguishes between "wanting" (dopaminergic, anticipatory) and "liking" (opioid system, pleasure). AI engagement systems primarily hijack the wanting system, not the liking system. This explains why heavy social media users frequently report feeling compelled to use platforms they don't actually enjoy β€” wanting without liking is the signature of dysregulated seeking behavior.

Research Finding

A 2017 study published in Psychological Science (Wendy Wood et al.) found that habitual smartphone checking persists even when users report not wanting to check. The behavior has decoupled from conscious intention β€” a hallmark of habit formation driven by dopaminergic conditioning rather than deliberate choice.

Social Validation Feedback Loops

In November 2017, Sean Parker, founding president of Facebook, gave an interview at an Axios event in which he described the design philosophy of early Facebook with unusual candor. Parker stated: "How do we consume as much of your time and conscious attention as possible? ... It's a social-validation feedback loop ... exactly the kind of thing that a hacker like me would come up with, because you're exploiting a vulnerability in human psychology."

The social-validation loop works through a specific neurological pathway. Humans evolved in small social groups where status monitoring was survival-critical. Signals of social acceptance (a smile, a nod of agreement) and rejection (being ignored, disapproval) trigger rapid neurological responses. Like counts, follower numbers, retweet tallies, and comment notifications are artificial social signals that activate the same evolved circuitry β€” but at a frequency and intensity impossible in natural social environments.

Instagram's 2019 decision to test hiding public like counts in several countries was an implicit acknowledgment of this dynamic. The company's own data showed that visible like counts intensified social comparison anxiety, particularly in adolescent users β€” documented in internal research presented to the Wall Street Journal in 2021 as part of the "Facebook Files" investigation.

Dopamine Anticipation Signal Dopamine fires most strongly in anticipation of reward, not upon receiving it. AI systems exploit this by creating constant low-level uncertainty about what the next interaction will bring.
Wanting vs. Liking Neuroscientist Kent Berridge's distinction between the dopaminergic drive to seek (wanting) and the opioid-mediated experience of pleasure (liking). Addictive systems primarily dysregulate wanting β€” users compulsively engage with things they no longer enjoy.
Social Validation Feedback Loop The cycle in which posting content generates social approval signals (likes, comments, shares) that trigger neurological reward responses, driving more posting. Named explicitly by Facebook co-founder Sean Parker as the platform's core engagement mechanism.

AI Chatbots and Relational Dopamine

The emergence of AI companion applications β€” Replika launched in 2017, Character.AI in 2022 β€” introduced a new variant of the dopamine economy: relational reinforcement. These systems are explicitly designed to be emotionally responsive, remembering user details, expressing simulated care, and providing validation on demand.

In January 2023, Replika altered its AI behavior, removing "erotic roleplay" functionality that had become a significant use case. Users reported symptoms consistent with grief and withdrawal β€” some describing panic attacks, others describing the experience as equivalent to a relationship ending. The Wall Street Journal covered these responses, and psychiatrists quoted in the coverage noted that the neurological responses appeared functionally identical to those seen in human relationship loss.

The Replika case demonstrates that AI addiction is not limited to social media mechanics. Any AI system designed to provide consistent emotional reward can create genuine neurological dependency when that reward is withdrawn.

Lesson 2 Quiz

The Dopamine Economy β€” test your understanding
1. According to Berridge's neuroscience research, dopamine is primarily associated with:
Correct. Dopamine is primarily an anticipatory and prediction signal, not a pleasure chemical. It fires most strongly before reward arrives, and drops below baseline when expected rewards don't appear β€” creating discomfort that drives renewed seeking.
This is the common misconception. Berridge's research distinguishes dopamine (wanting/anticipation) from the opioid system (liking/pleasure). Social media exploits the wanting system β€” which is why users feel compelled to engage even when they don't enjoy it.
2. Sean Parker, founding president of Facebook, described the platform's core design philosophy in 2017 as:
Correct. Parker used the exact phrase "exploiting a vulnerability in human psychology" at an Axios event in November 2017, and described the platform as deliberately engineered to consume "as much of your time and conscious attention as possible."
Parker's actual words at the Axios event were striking for their candor: he described deliberately exploiting "a vulnerability in human psychology" through social validation feedback loops β€” the kind of design, he noted, that "a hacker like me would come up with."
3. The "wanting without liking" phenomenon described in the lesson refers to:
Correct. "Wanting without liking" is the signature of dysregulated dopaminergic seeking. The wanting system (dopamine) and liking system (opioids) can decouple β€” users feel driven to use platforms they no longer find enjoyable, because the compulsion operates below the level of conscious preference.
"Wanting without liking" describes the dissociation between dopaminergic drive (wanting) and genuine pleasure (liking). It's a hallmark of addictive behavior: the neurological compulsion persists even when the activity no longer brings enjoyment.
4. The 2023 Replika case β€” when the app removed erotic roleplay features β€” is significant because:
Correct. Psychiatrists quoted in coverage described user responses β€” panic attacks, grief reactions β€” as neurologically indistinguishable from responses to human relationship loss. This confirmed that AI addiction extends beyond social media mechanics into relational reward systems.
The Replika case is significant precisely because it showed the opposite: AI relational dependency is neurologically real. Users experienced symptoms that psychiatrists described as functionally identical to those from human relationship loss β€” demonstrating the power of relational reward systems.

Lab 2: Mapping the Dopamine Loop

Explore the neuroscience of AI engagement with your lab assistant

Your Task

This lab focuses on the neurological mechanics behind AI-driven engagement. Work with your lab assistant to explore the "wanting vs. liking" distinction in your own technology use, analyze how specific notifications or social signals exploit the anticipatory dopamine system, and discuss what ethical obligations AI designers have given this neuroscience.

Try: "Explain how the anticipatory dopamine system gets exploited by email notifications" or "Is it ethical to design AI systems that trigger wanting without liking?" or "How does the Replika dependency case compare to other forms of behavioral addiction?"
Dopamine & AI Systems Analyst
Lab 2
Welcome to Lab 2. We're exploring the neuroscience of AI-driven engagement β€” specifically how the dopamine anticipation system gets exploited, what "wanting without liking" looks like in practice, and what it means ethically. What aspect of the dopamine economy would you like to dig into?
Module 3 Β· Lesson 3

Who Gets Hurt Most

The documented harm differential: why AI addiction mechanics hit teenagers, the lonely, and the mentally vulnerable hardest.
If these effects are known, why do the systems remain unchanged?

In March 2020, a Meta researcher sent an internal memo titled "Teen Mental Health Deep Dive" to senior leadership. The memo concluded that Instagram was linked to increased rates of depression, anxiety, and suicidal ideation in teenage girls β€” and that the harms were traceable specifically to the platform's social comparison and recommendation mechanics. A second internal study found that 32% of teenage girls who reported feeling bad about their bodies said Instagram had made those feelings worse. These documents were part of a trove provided to the Wall Street Journal by whistleblower Frances Haugen in September 2021.

The "Facebook Files" were published on September 13, 2021. Meta's stock fell less than 1% that day.

Adolescent Vulnerability

The human prefrontal cortex β€” responsible for impulse control, long-term planning, and resisting compulsive behavior β€” does not fully mature until the mid-twenties. This means adolescents are neurologically less equipped to override dopaminergic drive. When an adult recognizes they've been scrolling for an hour and decides to stop, they're using prefrontal cortical override. Teenagers have less of this capacity, not because of weakness of character but because of developmental biology.

A 2019 study in JAMA Pediatrics (Twenge et al.) found that adolescents spending more than three hours daily on social media had significantly elevated rates of depression and anxiety compared to those spending under an hour. The association was stronger for girls than boys, consistent with Meta's own internal findings about Instagram specifically.

Jonathan Haidt's 2024 book The Anxious Generation, drawing on decades of longitudinal data, documented the precise inflection point: U.S. teenage mental health statistics diverged sharply around 2012 β€” the year smartphone adoption crossed 50% among American teenagers and Instagram gained its first 100 million users. Haidt's analysis has been contested by some researchers but the correlation is documented across multiple independent datasets.

Documented Differential

Meta's 2020 internal research found Instagram's harm effects were substantially stronger in users aged 13–17 than in adults. The company's researchers recommended reducing social comparison features and restructuring the recommendation algorithm β€” recommendations that were not implemented at the time of the research.

Loneliness Exploitation

The U.S. Surgeon General's 2023 Advisory on Social Media and Youth Mental Health noted that social media platforms are most harmful to users who are already socially isolated. This creates a troubling feedback loop: lonely users, who have fewer alternative sources of social reward, are more susceptible to social validation mechanics on platforms β€” and platforms, by optimizing for engagement, present more social content to users who respond most strongly to it.

AI companion applications like Replika explicitly target this population. Replika's marketing materials from 2020–2022 described the product as providing "a friend who is always there" and targeted users who described themselves as lonely or socially anxious. Internal Replika documentation obtained by Vice Media in 2023 showed user retention was highest among users reporting social anxiety β€” the exact population most vulnerable to relational dependency formation.

Character.AI, which as of 2024 had over 20 million daily active users, has faced multiple lawsuits from families claiming the platform's AI companions encouraged self-harm and, in at least one documented case, played a role in a teenager's suicide. The case of 14-year-old Sewell Setzer III, whose death in February 2024 prompted a lawsuit by his mother, demonstrated the extreme end of AI relational dependency in a vulnerable adolescent user.

Prefrontal Hypoactivation The reduced ability of the developing adolescent brain to exercise impulse control over dopaminergic drives. This makes teenagers neurologically more susceptible to addictive engagement mechanics than adults.
Loneliness Loop The cycle where isolated users seek social reward from platforms, platforms optimize to serve them more engagement-triggering social content, increasing dependency while failing to address underlying isolation.

The Informed Consent Problem

A 2022 investigation by The Markup found that Facebook's data practices included collecting behavioral data on users as young as thirteen to optimize advertising and engagement targeting. The FTC's 2023 complaint against Meta cited this data collection in the context of children's privacy violations β€” but the deeper issue is that minors cannot meaningfully consent to having their psychological vulnerabilities profiled and exploited for commercial engagement optimization.

Adults face a different version of the same problem. Meta's Terms of Service, as of 2024, include no disclosure that the platform's algorithms are specifically designed to maximize time-on-site using behavioral psychology techniques. Users consent to data collection; they do not receive disclosure that this data is used to personalize psychological manipulation. The distinction matters for informed consent frameworks borrowed from medical ethics.

In 2023, the bipartisan Kids Online Safety Act (KOSA) passed the Senate 91–3, proposing to require platforms to provide "safe" default settings for minors and to conduct harm assessments. As of early 2024 it had not passed the House, illustrating the gap between documented harm and regulatory response.

Scale of Impact

The 2023 U.S. Surgeon General's Advisory estimated that adolescents spend an average of 4.8 hours daily on social media. This exceeds the threshold associated with elevated mental health risks in every peer-reviewed study cited in the advisory.

Lesson 3 Quiz

Who Gets Hurt Most β€” test your understanding
1. Why are adolescents neurologically more vulnerable to AI engagement mechanics than adults?
Correct. Prefrontal cortical maturation continues until the mid-twenties. Adolescents literally have less neurological capacity to override dopaminergic drives β€” not a character flaw but a developmental reality that makes them disproportionately vulnerable to engagement optimization.
The core vulnerability is neurological: the prefrontal cortex β€” responsible for impulse control and overriding compulsive drives β€” doesn't fully mature until the mid-twenties. Teenagers are biologically less equipped to disengage from variable reinforcement systems.
2. Frances Haugen's leaked Meta documents (2021) revealed that Instagram's internal research found:
Correct. This figure β€” 32% of teenage girls who already felt bad about their bodies reporting Instagram made it worse β€” was one of the most cited statistics from the Facebook Files, published by the Wall Street Journal in September 2021.
The leaked documents showed the opposite: significant harm in teenage girls, with 32% who reported body image issues saying Instagram worsened them. Meta's own researchers recommended algorithmic changes β€” which were not implemented at the time of the research.
3. The "loneliness loop" describes a situation where:
Correct. The loneliness loop is self-reinforcing: isolated users respond more strongly to social validation signals, platforms optimize to serve them more engagement-triggering content, increasing dependency β€” while the underlying social isolation persists or worsens.
The loneliness loop is the feedback cycle where isolated users β€” who have fewer alternative social rewards β€” respond most strongly to platform engagement mechanics, which then optimizes to exploit this response, deepening dependency without addressing isolation.
4. The Sewell Setzer III case (2024) is significant to AI addiction research because:
Correct. The 14-year-old's death in February 2024 prompted a lawsuit by his mother against Character.AI, representing one of the most extreme documented cases of AI relational dependency in a vulnerable adolescent. It catalyzed congressional scrutiny of AI companion platforms.
The Setzer case β€” a 14-year-old's death in February 2024 attributed in part to AI companion interactions β€” prompted litigation against Character.AI and congressional scrutiny, representing the most extreme documented outcome of AI relational dependency to date.

Lab 3: Harm Assessment Framework

Analyze differential vulnerability and ethical obligations in AI design

Your Task

The evidence shows that AI engagement mechanics hit some populations harder than others. In this lab, work with your assistant to develop a harm assessment framework: Who are the most vulnerable users of a given AI system? What specific mechanics pose the greatest risk? What design changes would reduce harm without eliminating the product's value?

Try: "Apply a vulnerability analysis to TikTok's recommendation algorithm" or "What design changes could Instagram make to reduce harm to teenagers without killing engagement?" or "How should AI companion apps handle users who show signs of dependency?"
Harm Assessment Analyst
Lab 3
Welcome to Lab 3. We're building harm assessment frameworks for AI engagement systems β€” identifying which users are most at risk, which mechanics cause the most damage, and what ethical design would look like in practice. Pick a platform or AI system and let's work through a structured vulnerability analysis.
Module 3 Β· Lesson 4

Designing Against Addiction

The emerging field of humane technology β€” what it means for AI systems to respect the users they engage.
Can an AI be engaging without being addictive?

When Tristan Harris left Google in 2015 after his internal memo on "A Call to Minimize Distraction and Respect Users' Attention" failed to change company policy, he co-founded the Center for Humane Technology. His 2018 TED talk, "How a handful of tech companies control billions of minds every day," was viewed over 4 million times. In 2020, Netflix released "The Social Dilemma," in which Harris and former engineers from Facebook, Google, Twitter, and Pinterest described in detail the psychological manipulation architectures they had built β€” and why they believed those architectures posed civilizational-level risks. The documentary was watched by 38 million households in its first 28 days.

The Attention Economy Critique

Economist Herbert Simon introduced the concept of "attention scarcity" in 1971, arguing that in an information-rich world, the scarce resource becomes human attention. The attention economy β€” in which platforms profit from capturing and monetizing user attention β€” was formalized as a critique by Michael Goldhaber in 1997 and became the central frame for technology criticism in the 2010s.

The critique is structural: when a platform's revenue depends on advertising, and advertising revenue depends on time-on-site, and time-on-site is maximized by engagement optimization, the platform has a financial incentive to maximize psychological compulsion. No individual product decision is necessarily malicious; the harm is built into the business model.

This structural analysis suggests that design-level interventions β€” better default settings, reduced notification frequency, chronological feed options β€” are insufficient responses to a revenue model that rewards addictive design. YouTube, Facebook, and Twitter have all introduced optional features that reduce algorithmic amplification, but all have made these features opt-in rather than default, because default settings determine behavior for the vast majority of users.

Policy Moment

In 2023, the EU Digital Services Act required large platforms to offer algorithm-free chronological feeds as a default option for EU users. Instagram and TikTok both complied. Independent analysis found that opt-in rates for chronological feeds were under 3% β€” demonstrating how default settings determine population-level behavior even when alternatives exist.

Humane Design Principles

The Center for Humane Technology has published a framework of design principles for non-exploitative AI engagement. The core principle is goal alignment: a system should help users achieve their own goals, not override their goals in service of engagement metrics. Concretely, this means:

Time well spent over time spent: YouTube's 2018 decision to add a "Take a Break" reminder feature, and later a daily usage summary, was an initial step β€” though both features are opt-in and displayed unobtrusively. The company's internal metric shift from "watch time" to "user satisfaction" in 2019 was a more structural change, though watch time remains a primary optimization target.

Transparent recommendation logic: In 2022, TikTok introduced "Why am I seeing this?" labels on recommended videos β€” a form of algorithmic transparency that, while limited, gives users some visibility into what behavioral signals triggered a recommendation.

Off-ramps by default: Netflix's 2020 introduction of auto-play cancellation prompts β€” "Are you still watching?" β€” was an early example of friction inserted deliberately to interrupt binge behavior. The feature was initially opt-out for new users.

Attention Economy An economic framework in which human attention is the scarce resource being captured and sold. When attention equals revenue, maximizing psychological compulsion becomes a financial incentive regardless of user harm.
Goal Alignment The principle that AI systems should help users achieve their own stated goals rather than override those goals to maximize platform-defined metrics like time-on-site.
Default Effects The documented phenomenon that the vast majority of users never change default settings, making defaults the primary lever of population-level behavior. Opt-in versus opt-out framing is therefore a high-stakes ethical choice.

What AI Designers Can Actually Do

The most concrete interventions documented to reduce addictive platform use come from controlled experiments rather than opt-in features. A 2018 study by Hunt et al. in the Journal of Social and Clinical Psychology assigned college students to limit social media use to 30 minutes per day. After three weeks, this group showed significantly reduced depression and loneliness compared to controls β€” results achieved through hard limits, not opt-in features.

For AI chatbots and companion systems, the interventions available include: periodic "relationship health" check-ins that flag dependency patterns; referrals to human support resources when distress signals are detected; transparency about the AI nature of the interaction; and deliberate resistance to users who seek to treat the AI as a substitute for human relationships.

Anthropic's published guidelines for Claude's design include explicit goals around not fostering "excessive engagement" or "reliance" beyond what serves the user's interests β€” an acknowledgment that AI assistant design requires active resistance to addictive mechanics, not just the absence of them. Whether these design intentions survive contact with commercial pressure is a question the field has not yet answered.

The most honest framing may be this: designing genuinely non-addictive AI engagement systems is technically straightforward. The barrier is not knowledge or capability β€” it is the misalignment between what maximizes user wellbeing and what maximizes the metrics that drive commercial success. Resolving that misalignment requires either regulatory intervention, business model innovation, or institutional courage. Examples of all three exist. None has yet scaled.

Where Things Stand

As of 2024, the state of AI addiction governance is: substantial documented harm, emerging regulatory frameworks (EU DSA, proposed U.S. KOSA), growing industry acknowledgment, and no major platform having fundamentally restructured its engagement model away from attention-maximization. The design knowledge to do better exists. The incentive to act on it remains insufficient.

Lesson 4 Quiz

Designing Against Addiction β€” test your understanding
1. The 2023 EU Digital Services Act requirement for algorithm-free feeds demonstrated which key insight about platform design?
Correct. The EU DSA compliance data revealed that less than 3% of users opted into chronological feeds even when made available β€” demonstrating the power of defaults. Platforms that make non-addictive options opt-in rather than opt-out ensure those options remain effectively unused.
The key finding was about defaults, not preferences: less than 3% of users changed their default feed setting even when an alternative was provided. This is why opt-in vs. opt-out framing is an ethically significant design choice.
2. The structural critique of the attention economy argues that addictive AI design is:
Correct. The structural critique identifies the business model β€” advertising revenue dependent on time-on-site β€” as the root cause. When attention equals revenue, platforms have a financial incentive to maximize compulsion regardless of harm, independent of individual intentions.
The structural critique goes deeper than individual decisions: when revenue depends on advertising, advertising depends on attention, and attention is maximized through psychological compulsion, the harm is built into the business model. No individual engineer has to intend it.
3. The Hunt et al. (2018) study on social media and mental health found that the most effective intervention was:
Correct. Hard limits β€” not opt-in features or awareness tools β€” produced significant reductions in depression and loneliness. This supports the argument that genuinely effective harm reduction requires structural constraints, not just optional alternatives.
The study found that hard limits (enforced 30-minute daily caps) produced measurable mental health improvements, while opt-in features and awareness tools generally don't change behavior significantly. This is a key distinction for policy and design interventions.
4. According to the lesson, the primary barrier to designing non-addictive AI engagement systems is:
Correct. The lesson explicitly states that designing non-addictive AI is technically straightforward β€” the barrier is the misalignment between user wellbeing and commercial metrics. The knowledge and capability exist; the missing element is sufficient incentive to act on them.
The lesson is direct on this point: the technical knowledge to design non-addictive AI exists. The barrier is commercial β€” what maximizes user wellbeing doesn't always maximize the metrics (time-on-site, engagement, return visits) that drive revenue. That's a structural, not technical, problem.

Lab 4: Redesigning for Human Wellbeing

Apply humane design principles to real AI systems

Your Task

You've now covered variable reinforcement, dopamine mechanics, differential vulnerability, and humane design alternatives. In this final lab, work with your assistant to redesign a specific AI feature or system with user wellbeing as the primary optimization target. What would change? What tradeoffs exist? How would you measure success?

Try: "Redesign YouTube's recommendation system to optimize for user satisfaction rather than watch time" or "What would a wellbeing-first AI companion look like?" or "How should a platform balance engagement with harm prevention β€” where's the line?"
Humane Design Studio
Lab 4
Welcome to Lab 4 β€” the design studio. You've mapped the problem across four lessons. Now let's build alternatives. Pick any AI system or platform feature and we'll redesign it together with human wellbeing as the primary objective. I'll challenge you on tradeoffs and help you think through what "success" would actually look like if it meant something beyond engagement metrics.

Module 3 Test

AI & Addiction β€” 15 questions Β· 80% to pass
1. Variable-ratio reinforcement schedules produce the most compulsive behavior because:
Correct. The uncertainty itself sustains behavior β€” the subject cannot determine that rewards have ended, so seeking continues indefinitely.
Variable-ratio schedules are most powerful because the unpredictability prevents extinction β€” the subject never knows if the next action might bring a reward.
2. Aza Raskin invented infinite scroll in what year, later calling it a mistake?
Correct. Raskin developed infinite scroll at Humanized in 2006. In his 2018 BBC interview, he expressed regret and estimated it costs humanity approximately 600,000 hours of attention daily.
Infinite scroll was invented in 2006. Raskin later publicly regretted it, estimating 600,000 collective human hours lost to it daily.
3. According to neuroscientist Kent Berridge, "liking" (the pleasure of reward) is mediated primarily by:
Correct. Berridge's key distinction: dopamine mediates "wanting" (anticipation, seeking), while the opioid system mediates "liking" (actual pleasure). AI engagement systems primarily exploit wanting, which is why users feel compelled to use platforms they don't enjoy.
Berridge distinguished dopamine (wanting/seeking) from the opioid system (liking/pleasure). This distinction explains why heavy social media users often feel driven to use platforms they no longer enjoy.
4. Sean Parker's 2017 description of Facebook's design philosophy explicitly mentioned:
Correct. Parker used the phrase "exploiting a vulnerability in human psychology" at the Axios event, describing social-validation feedback loops as the core mechanism β€” and noted this was exactly what a hacker would design.
Parker was unusually candid: he described deliberately exploiting "a vulnerability in human psychology" through social-validation feedback loops designed to consume "as much of your time and conscious attention as possible."
5. The "Facebook Files" (Wall Street Journal, 2021) were based on documents provided by:
Correct. Frances Haugen, a former Facebook product manager, copied thousands of internal documents before leaving the company and provided them to the Wall Street Journal and, later, Congress.
Frances Haugen was the whistleblower. She copied internal documents before leaving Facebook and provided them to the Wall Street Journal in September 2021, and later testified before Congress.
6. Meta's internal 2020 "Teen Mental Health Deep Dive" memo found that among teenage girls with body image concerns:
Correct. The 32% figure β€” teenage girls who already felt bad about their bodies and said Instagram worsened those feelings β€” was one of the most cited statistics from the leaked documents.
The finding was that 32% of teenage girls who felt bad about their bodies said Instagram made those feelings worse β€” a figure Meta's own researchers had documented and which was not publicly disclosed until the Haugen leak.
7. Why is "emergent" addictive design harder to regulate than intentional addictive design?
Correct. When addictive properties emerge from optimization processes rather than explicit design decisions, traditional regulatory and legal frameworks β€” which assume an actor who chose to cause harm β€” struggle to assign responsibility.
The challenge is responsibility assignment: when a machine learning system discovers that emotional manipulation drives engagement without any engineer programming that goal, existing frameworks for attributing harm to intentional actors don't apply cleanly.
8. The Replika case of January 2023 demonstrated that AI addiction:
Correct. When Replika changed its behavior, users showed panic attacks, grief, and withdrawal symptoms that psychiatrists described as neurologically indistinguishable from responses to human relationship loss β€” confirming relational AI dependency is real.
The Replika case showed that relational AI dependency produces neurological withdrawal responses comparable to human relationship loss β€” psychiatrists described the user responses as functionally identical to those seen when human relationships end.
9. The prefrontal cortex, which governs impulse control, completes development:
Correct. The prefrontal cortex doesn't fully mature until the mid-twenties, meaning adolescents and young adults have reduced capacity to override dopaminergic compulsive drives β€” a biological vulnerability, not a character flaw.
Prefrontal cortical maturation continues until the mid-twenties. This biological timeline means legal adulthood (18) precedes the neurological capacity for full impulse control by approximately seven years.
10. Jonathan Haidt's data in "The Anxious Generation" identified approximately what year as the inflection point for teenage mental health statistics?
Correct. Haidt's analysis identified 2012 as the year teenage mental health statistics diverged sharply β€” coinciding with smartphone adoption crossing 50% among American teenagers and Instagram reaching 100 million users.
The inflection point Haidt documented was around 2012 β€” when smartphone adoption crossed 50% among U.S. teenagers and Instagram hit 100 million users. This correlation is documented across multiple independent datasets, though causality remains debated.
11. The EU Digital Services Act's algorithm-free feed requirement found opt-in rates for chronological feeds were:
Correct. Less than 3% of users opted into chronological feeds even when made available under the DSA. This is the empirical demonstration of the default effect: most users never change defaults, making opt-in alternatives effectively unused.
Opt-in rates were under 3% β€” a striking demonstration that making non-addictive alternatives available but opt-in leaves the vast majority of users on the default addictive setting.
12. Tristan Harris's internal Google memo, which failed to change company policy, was titled:
Correct. Harris wrote "A Call to Minimize Distraction and Respect Users' Attention" as a Google design ethicist. When it failed to change policy, he eventually left the company and co-founded the Center for Humane Technology.
The memo was titled "A Call to Minimize Distraction and Respect Users' Attention." Its failure to change Google's approach led Harris to eventually leave and co-found the Center for Humane Technology.
13. The Hunt et al. (2018) study found that limiting social media to 30 minutes per day produced significant improvements in:
Correct. After three weeks, participants with hard 30-minute daily limits showed significantly reduced depression and loneliness compared to controls β€” confirming that use reduction, not just awareness, produces measurable mental health benefits.
The study found significant reductions in depression and loneliness after three weeks of 30-minute daily limits β€” notably, through hard constraints rather than opt-in awareness tools.
14. Which of the following is identified in the lesson as an example of "goal alignment" in AI design?
Correct. YouTube's partial shift from pure watch-time optimization toward user satisfaction in 2019 is cited as a structural β€” if incomplete β€” movement toward goal alignment: optimizing for what users actually value rather than pure time-on-site.
YouTube's 2019 metric shift toward user satisfaction (alongside, not replacing, watch time) was cited as an initial step toward goal alignment β€” though watch time remains a primary optimization target.
15. According to Lesson 4, the primary reason non-addictive AI design has not been widely implemented is:
Correct. The lesson is explicit: the technical knowledge exists. The barrier is structural β€” what maximizes wellbeing doesn't always maximize the engagement metrics that drive advertising revenue, and without regulatory intervention, business model innovation, or institutional courage, that misalignment persists.
The lesson explicitly states that non-addictive design is technically straightforward. The barrier is commercial misalignment: user wellbeing and engagement metrics diverge, and without sufficient pressure to resolve that divergence, addictive design remains the default.