Lesson 1: AI You See Every Day
Voice assistants, recommendation engines, autocorrect, games — and the invisible infrastructure underneath all of it.
In 2018, Amazon quietly revealed that its Alexa voice assistants had been recording conversations and sending them to random contacts in users' address books — a bug triggered by misheard wake words. Amazon's response framed it as an edge case. Privacy researchers framed it as the inevitable consequence of running always-on microphones in living rooms at scale. The device was not malfunctioning. It was doing exactly what it was designed to do, just in conditions the designers had not adequately modeled.
The incident drew brief media coverage and then largely faded. Alexa device sales did not drop significantly. This asymmetry — a serious privacy failure that produced minimal behavioral change — is itself a data point about the relationship between people and ambient AI. Convenience had been priced; the surveillance infrastructure had been normalized before the privacy failures arrived.
The question this lesson asks is not whether voice assistants are good or bad. It is: what exactly is happening inside the AI stack that surrounds you, and what are the structural consequences of not knowing?
The Invisible AI Stack
AI is not a feature you turn on. For most users, it is the medium through which digital life is experienced. Your phone's keyboard predicts text using a small language model trained on your writing patterns and aggregate usage data. Your email client filters spam using a classifier trained on billions of labeled messages. Your streaming service curates recommendations using collaborative filtering that cross-references your behavior against millions of others. Your map app predicts traffic using a spatiotemporal model ingesting GPS telemetry from every active phone on the road.
Each individual system makes thousands of micro-decisions per user per day. In aggregate, AI now mediates a substantial fraction of human information consumption, social interaction, and economic activity — without explicit notification, without user-accessible explanation, and in most cases, without meaningful ability to opt out.
🔑 Ambient AI
The term "ambient AI" describes systems so embedded in infrastructure that users interact with them unconsciously. The ethical question is not whether ambient AI is good or bad in aggregate — it is whether informed consent is possible when the system is invisible, and what accountability structures can exist when the infrastructure is proprietary.
Recommendation Systems at Scale
Recommendation engines — for content, products, connections, and news — are among the highest-impact AI deployments by sheer user-hours affected. The dominant approach is collaborative filtering: a model trained to predict what a user will engage with based on what similar users engaged with. This creates pressure toward whatever maximizes the predicted engagement metric, which is not always what maximizes user wellbeing.
Facebook's internal research, leaked in the 2021 Frances Haugen disclosures, found that the platform's recommendation system amplified emotionally activating content — particularly outrage — because outrage reliably drove engagement metrics. The system was not broken. It was doing precisely what it was optimized to do. The question is what objectives recommendation systems should be optimized for — and who decides.
🌟 The Optimization Problem
Every recommendation system embeds a value judgment in its objective function. Maximizing click-through rate is not a neutral choice. Neither is maximizing watch time, likes, or shares. The choice of metric determines what behavior the AI amplifies. Understanding that choice — and who made it, for what reasons — is essential to understanding AI in the world.
Voice Assistants: The Architecture of Listening
Voice assistants (Alexa, Siri, Google Assistant) operate on a wake-word detection model running locally on device. When the wake word is detected, audio is streamed to cloud servers for processing. This architecture means that audio fragments containing wake-word false positives are regularly recorded and transmitted. The companies involved acknowledged employing human contractors to review recordings for product improvement — a practice that was not disclosed in terms of service and that users largely did not know was occurring.
The privacy implications compound across a household. A device in a shared space records ambient conversation from every person present, including guests and children, regardless of whether those individuals have agreed to any terms. In 2019, Belgian consumer groups and data protection authorities found that Amazon's retention of voice recordings without adequate disclosure violated GDPR. The systemic issue was not Amazon's uniquely bad practices — it was that the entire category of ambient listening devices required re-examination of consent models designed for individual, opt-in interactions.
Quiz 1: AI You See Every Day
5 questions — free, untracked, retake anytime.
🧪 What is the core mechanism behind most recommendation systems?
🧪 What did Facebook's internal research find about its recommendation algorithm?
🧪 Why does the Alexa recording incident illustrate a systemic issue rather than just a bug?
🧪 What is embedded in every recommendation system's objective function?
🧪 When do voice assistants transmit audio to cloud servers?
Lab 1: AI Stack Audit
Map the AI systems in your daily life — and interrogate their objective functions.
Lab 1 — AI Stack Audit
Name an app or device you use regularly. The AI will break down what AI systems it likely contains, what those systems are optimizing for, what data they collect, and what the structural consequences of those choices might be.
- Name an app, device, or platform.
- The AI will audit its likely AI stack.
- Push back, add detail, or name a second system for comparison.
Lesson 2: AI at School and at Play
Educational AI tools; AI in sports and games — and the deeper questions about learning, performance, and authenticity.
In early 2023, school districts across the US scrambled to respond to ChatGPT. Administrators feared academic dishonesty; students argued that learning to use AI tools was itself a skill; teachers were split between enforcement and adaptation. The New York City Department of Education initially blocked ChatGPT on school networks. Within months, they reversed the policy and began piloting an educational chatbot instead.
The reversal reflected a structural reality: blocking a tool students could access on their phones did not prevent use, it only prevented supervised use. The more durable question was not whether to allow ChatGPT but what learning actually requires, and which parts of the learning process AI assistance undermines versus enhances. Answering that question requires having a theory of what school is for — which turns out to be surprisingly contested.
The educational AI moment is not primarily a policy question. It is a question about what counts as learning, who assessments are actually measuring, and whether systems designed to evaluate knowledge production can survive tools that make knowledge production trivially easy.
Educational AI: The Landscape
AI in education spans a wide range of applications: adaptive learning platforms (Khan Academy's Khanmigo, Duolingo), automated essay scoring, plagiarism and AI-use detection, tutoring systems, accessibility tools for students with disabilities, and generative AI tools that students use outside official channels. Each raises different questions about what it measures, what it augments, and what it potentially undermines.
Adaptive learning systems have a genuine evidence base: spaced repetition, mastery-based progression, and personalized feedback loops all have demonstrated learning benefits. The concern is about displacement — systems that substitute for the friction-heavy, cognitively demanding work that produces durable learning (writing a draft, struggling with a concept, receiving and incorporating critical feedback) with frictionless generation that feels productive but may not build the same capacities.
🔑 The Desirable Difficulty Problem
Cognitive science research on "desirable difficulties" shows that learning often feels harder when it's working. Spaced practice, interleaved topics, and retrieval over re-reading are all less comfortable than passive review — and more effective. AI tools that make cognitively demanding tasks easy may be optimizing for the feeling of learning over its actual outcomes.
AI in Sports: Performance, Surveillance, Authenticity
Professional sports have become major AI deployment sites. Player tracking systems analyze biomechanics to predict and prevent injury. Video analysis identifies opponent tendencies and generates game plans. Wearables monitor physiological data continuously. Predictive models guide draft decisions, lineup choices, and contract valuations — the statistical revolution in baseball documented in Moneyball became, within two decades, the operating model across every major professional league.
The questions this raises move beyond performance: when athlete contracts are determined by algorithmic valuation and playing time is determined by AI recommendation, what happens to the human judgment of coaches and scouts? When injury prediction models recommend restricting a player's workload, who bears the cost if the recommendation is wrong? And at the amateur level, when AI game coaching tools become widely available, do they level the playing field or simply shift the advantage to those with better access to better tools?
🌟 Access and Authenticity
AI tools in competitive contexts — education, sports, creative fields — raise two questions that are often conflated. Access: does widespread availability level the playing field or reinforce advantage? Authenticity: does AI augmentation change what we're measuring or rewarding? These are different questions requiring different responses.
Quiz 2: AI at School and at Play
5 questions — free, untracked, retake anytime.
🧪 Why did NYC reverse its ChatGPT school ban so quickly?
🧪 What does "desirable difficulty" mean in cognitive science?
🧪 The statistical revolution in baseball documented in Moneyball became:
🧪 What are the two distinct questions AI tools in competitive contexts raise?
🧪 What core question does the ChatGPT-in-schools debate ultimately require answering?
Lab 2: The Assessment Design Challenge
Redesign an assessment that survives AI — by clarifying what it's actually measuring.
Lab 2 — The Assessment Design Challenge
Name a standard academic assessment (an essay, a research paper, a test, a project). The AI will analyze what cognitive skills it's actually measuring, which of those skills AI tools undermine, and what modifications could preserve the learning intent while acknowledging AI as a tool in the environment.
- Name the assessment and its subject.
- The AI will deconstruct what it's measuring and where AI changes the picture.
- Propose a redesign. The AI will stress-test it.
Lesson 3: AI in Our Community
Traffic systems, emergency services, local government — and the accountability gap when public decisions are made by private algorithms.
In 2016, ProPublica published a landmark analysis showing that COMPAS — an algorithmic risk assessment tool used in courtrooms across the United States — assigned higher recidivism risk scores to Black defendants than white defendants with comparable profiles. The company disputed the finding using different statistical metrics. Both were correct. This was not a measurement dispute. It was a values dispute that mathematics could not resolve.
Subsequent research demonstrated that the disagreement between ProPublica and Northpointe (COMPAS's developer) was mathematically inevitable: when base rates of reoffending differ between demographic groups — as they do, reflecting decades of unequal policing, prosecution, and incarceration — you cannot simultaneously satisfy multiple competing definitions of algorithmic fairness. You must choose. That choice is a decision about whose errors you're willing to tolerate — and that decision was made without public deliberation, by a private company, and embedded in a proprietary system used in life-altering legal proceedings.
Traffic, Infrastructure, and Smart Cities
AI-optimized traffic signal systems can reduce average commute times, lower emissions, and improve emergency vehicle routing. The benefits are real. The accountability questions are less often asked: when an algorithm determines how long an ambulance waits at a light, or whether a neighborhood's traffic pattern routes freight trucks through residential streets, who is responsible for those decisions? Who can be petitioned for change?
Smart city infrastructure collects continuous sensor data — pedestrian density, vehicle type, noise levels, air quality — that has uses well beyond traffic optimization. Contracts between cities and smart infrastructure vendors often give vendors broad data rights, with limited public disclosure. The public interest in efficient streets and the private interest in urban data are not always aligned.
🔑 The Accountability Gap
When a human official makes a bad decision, there is a chain of accountability: supervisor, elected official, court, press. When an algorithm makes a bad decision embedded in municipal infrastructure, that chain is interrupted. The decision was made by code; the code is proprietary; the vendor's contract limits disclosure. Democratic accountability for algorithmic governance is an open problem, not a solved one.
Emergency Services and Predictive Dispatch
AI systems inform fire department resource allocation, 911 call prioritization, and EMS routing. These applications have genuine performance benefits in aggregate. The failure cases are less publicized: algorithmic dispatch that misclassifies call urgency, resource allocation models that reflect historical deployment patterns (which may reflect historical inequities in neighborhood investment), and systems that cannot handle edge cases their training data did not include.
The challenge is not that AI cannot improve emergency services — in many cases it demonstrably does. It is that when an emergency service fails a community, the community needs to understand why, needs a mechanism for redress, and needs confidence that the failure was not systematic. Opaque algorithmic systems make those needs harder to satisfy, even when the system performs well in aggregate.
🌟 Aggregate vs. Individual Performance
An AI system that reduces average response time by two minutes while adding ten minutes in one neighborhood is not "working well." Aggregate performance metrics hide distributional outcomes. Evaluating AI in public services requires disaggregated analysis: who benefits, who bears the cost of failure, and whether the distribution is defensible.
Quiz 3: AI in Our Community
5 questions — free, untracked, retake anytime.
🧪 Why was the disagreement between ProPublica and Northpointe about COMPAS mathematically inevitable?
🧪 What creates the "accountability gap" in algorithmic governance?
🧪 Why might AI resource allocation in emergency services replicate existing inequities?
🧪 What does "aggregate vs. individual performance" mean in AI evaluation?
🧪 Smart city data contracts raise concern primarily because:
Lab 3: Algorithmic Fairness Impossibility
Work through why multiple fairness criteria can't be satisfied simultaneously.
Lab 3 — Algorithmic Fairness: The Impossible Choice
This lab works through the concrete mathematics and values questions behind the COMPAS case. The AI will present a simplified scenario where two standard fairness criteria produce different outcomes — and ask you to decide which you'd accept and why.
- The AI will describe a simplified risk scoring scenario with demographic base rate differences.
- Work through what each fairness criterion recommends.
- Decide which criterion to apply — and defend that choice.
Lesson 4: AI in Medicine and Science
Diagnosis, drug discovery, climate modeling — and the validation problem when AI outpaces our ability to check its work.
In 2020, a paper in Nature Medicine reported that an AI system trained on chest X-rays could detect COVID-19 pneumonia with high accuracy. The paper was widely covered and cited. Subsequent analysis found methodological problems: training and test data were taken from different hospitals with different imaging equipment, patient positioning, and scanning protocols. The model had not learned to detect pneumonia — it had learned hospital-specific imaging artifacts.
This pattern — AI achieving impressive benchmark performance that does not transfer to clinical deployment — is now well-documented in radiology, pathology, and dermatology. The failure mode is called "shortcut learning": models learn the easiest statistical signal that predicts the label in the training set, which is not always the clinically relevant signal. A model trained to distinguish malignant from benign skin lesions may have learned to detect the presence of a ruler (placed next to suspicious lesions for scale) rather than the lesion itself — because images with rulers were more likely to be malignant in the training set.
The lesson is not that medical AI doesn't work. AlphaFold demonstrably transformed protein science. Radiology AI has genuine clinical applications. The lesson is that the validation pipeline for AI in medicine must be designed with adversarial rigor — actively looking for the ways a model that performs well on paper might fail in a ward.
AI-Assisted Diagnosis: The Evidence Base
AI diagnostic tools have FDA approval or regulatory clearance across multiple medical imaging domains: diabetic retinopathy screening, breast cancer detection in mammography, certain cardiac imaging applications, and others. The evidence for some of these applications is strong — particularly in screening contexts where sensitivity at scale matters and where specialist access is limited.
The deployment gap — between performance in controlled trials and performance in routine clinical use — remains a persistent challenge. Contributing factors include distribution shift (patients in deployment differ from the training population), integration friction (AI tools must fit clinical workflows to be used correctly), and automation bias (clinicians may over-trust AI recommendations, reducing rather than augmenting their judgment).
🔑 Automation Bias
Automation bias describes the tendency to over-rely on automated recommendations even when human judgment would have caught an error. In medical AI, it creates a paradox: an AI that is 90% accurate might improve outcomes when used as a screening tool, but reduce outcomes if clinicians use it as a replacement for the clinical reasoning that would have caught the 10% of errors.
Drug Discovery and Scientific Acceleration
AlphaFold represents the clearest case of AI enabling scientific progress that was previously infeasible at scale. Its impact on structural biology — and downstream on drug discovery, antimicrobial resistance research, and basic science — is ongoing and expanding. Generative models for molecular design can explore chemical space for drug candidates at rates impossible for traditional screening. AI systems have identified potential antibiotic candidates active against resistant bacteria, a class of compounds that classical approaches had largely stopped finding.
The validation challenge is critical: AI can generate hypotheses, but experimental biology must validate them. The concern is not that AI makes too many wrong suggestions — classical approaches also produce many failed candidates — but that the economics of AI-generated hypotheses may shift resources toward computational prediction and away from the experimental infrastructure needed to validate them.
🌟 The AlphaFold Decision
DeepMind chose to make AlphaFold's predictions freely available via a public database — a decision with significant implications for who could benefit from protein structure prediction. This was a values decision about access, not a technical requirement. The same capability, deployed behind a commercial paywall, would have had different distributional consequences for global science.
Quiz 4: AI in Medicine and Science
5 questions — free, untracked, retake anytime.
🧪 What is "shortcut learning" in medical AI?
🧪 What is "automation bias" in clinical AI deployment?
🧪 Why was AlphaFold's decision to release predictions freely significant?
🧪 The COVID-19 X-ray AI failure illustrates what principle?
🧪 What is the concern about AI shifting drug discovery economics?
Lab 4: Validation Design for Medical AI
Design a validation protocol that would have caught the COVID X-ray failure before deployment.
Lab 4 — Validation Protocol Design
You've been asked to design a validation protocol for a new AI radiology system before it's deployed in a clinical setting. The AI will challenge your protocol by proposing realistic failure scenarios it wouldn't catch.
- Propose a validation protocol — what tests would you run, on what data, with what criteria for approval?
- The AI will present a realistic failure scenario your protocol might miss.
- Revise your protocol and defend the tradeoffs you're accepting.
Lesson 5: AI in Business and Work
Automation, customer service, productivity tools — and the labor economics of intelligent systems.
In March 2023, Goldman Sachs published a research report estimating that generative AI could expose 300 million jobs to automation. Media coverage was split between technologists arguing this was the next productivity revolution and labor economists arguing this was the most significant labor displacement event since industrialization. The disagreement was not about the technology — it was about speed, distribution, and history.
Historical evidence on automation and employment is genuinely mixed. Previous automation waves (looms, assembly lines, early computing) eliminated some jobs and created others, though transitions were often brutal for the workers in the eliminated roles and the communities depending on them. Economists argue about whether AI is fundamentally different — because it affects cognitive work, which had been the refuge of skilled labor as physical work was automated, and because AI capabilities are expanding faster than comparable historical transitions.
The empirical question — how many and which jobs AI will eliminate versus augment versus create — cannot be answered with current information. But the policy question — how to ensure that productivity gains from AI are distributed rather than concentrated — does not have to wait for empirical certainty to be addressed.
Algorithmic Management: The Invisible Boss
The most immediate labor story of AI is not automation of jobs but algorithmization of management. In gig economy platforms and increasingly in warehouse, retail, and service sector work, AI systems set pay rates, assign tasks, monitor performance, and make deactivation decisions with minimal human review. Workers are continuously scored and sorted; those who fall below thresholds face consequences with limited appeal mechanisms.
Sociologist Alex Rosenblat's research on Uber documented how algorithmic nudges — surge pricing, quest bonuses, earnings targets — effectively direct worker behavior without issuing explicit orders. Workers reported feeling that the app, not their own judgment, was making their decisions. The system maintained the legal fiction of independent contracting while producing direction and control that employment law would traditionally recognize as an employment relationship.
🔑 Classification and Accountability
The independent contractor classification allows platform companies to avoid labor law requirements — minimum wage, overtime, anti-discrimination protections — that apply to employees. This is not an accident. The classification is a strategic legal choice whose sustainability is now being challenged in courts and legislatures in the US, EU, and UK. How those cases resolve will determine the employment model of a significant fraction of the workforce.
White-Collar Automation and the Productivity Question
Studies of generative AI's impact on knowledge work — coding, writing, analysis, customer service — consistently show significant productivity gains for workers who adopt the tools, with larger gains for lower-performing workers than top performers. This suggests AI may compress the distribution of output quality: bringing lower-performing workers closer to current averages, while top performers gain less.
The distribution of those productivity gains is a policy question more than a technology question. If AI increases output per worker by 30%, does that translate to 30% more workers employed at the same pay, the same number of workers employed at 30% higher pay, or 30% fewer workers employed at the same pay with the remainder captured as profit? Historical evidence suggests outcomes depend heavily on labor market conditions, collective bargaining power, and policy choices — not on the technology itself.
🌟 The Distribution Question
The most important labor market question about AI is not "how many jobs will it eliminate?" It is "who captures the productivity gains?" The technology does not determine that distribution. Policy, power, and collective action do — and those are choices being made now, before the transition is complete, when they are most consequential.
Quiz 5: AI in Business and Work
5 questions — free, untracked, retake anytime.
🧪 What makes AI labor displacement potentially different from previous automation waves?
🧪 What does research consistently show about generative AI's productivity impact on knowledge workers?
🧪 How does algorithmic management maintain the "independent contractor" legal fiction?
🧪 What determines whether AI productivity gains translate into worker benefit versus profit capture?
🧪 Why is the independent contractor classification strategically important to platform companies?
Lab 5: Labor Policy Design
Design a policy response to algorithmic management in the gig economy.
Lab 5 — Labor Policy for the Algorithmic Workplace
You've been appointed to a labor policy task force tasked with addressing algorithmic management. The AI will present the constraints you're operating under — legal, economic, political — and challenge the policy you propose.
- Propose a policy: reclassification, algorithmic transparency requirements, algorithmic fairness standards, sectoral bargaining, or something else.
- The AI will present the strongest counterarguments from platform companies, workers who prefer flexibility, and economists.
- Revise your proposal or defend it under pressure.
Lesson 6: AI in Art, Music, and Culture
Generative media, deepfakes, cultural impact — and the consent question at the heart of AI training on human creative work.
In 2022, visual artist Jason Allen submitted a piece titled "Théâtre D'Opéra Spatial" to the Colorado State Fair fine arts competition. The image was generated using Midjourney. It won first place. Allen disclosed the AI assistance in his submission. When the win was reported, the backlash was immediate: artists argued the work was not Allen's, that awarding it devalued human creative labor, and that the competition's rules had not contemplated this category of submission.
Allen argued that prompting, curation, and iteration were themselves creative acts — that selecting from thousands of generated candidates and refining the prompt to produce a specific aesthetic vision required skill and judgment. Both sides were making coherent arguments from different premises about what art is and what authorship requires. The competition has since updated its rules. The underlying argument has not been resolved.
The AI art debate is not primarily about this particular incident. It is about consent, attribution, and compensation at scale: the generative AI models that produced Allen's winning image were trained on billions of images created by human artists who did not consent to their work being used as training data and who receive no compensation when their style is reproduced. That structural question is in litigation and legislation simultaneously.
Training Data: The Copyright and Consent Question
Text-to-image models (Midjourney, DALL-E, Stable Diffusion) and text-to-music models were trained on large datasets of human-created work scraped from the internet. Artists, photographers, writers, and musicians whose work was included generally were not asked, did not consent, and do not receive compensation when their style is reproduced or their name is invoked as a prompt. Getty Images, several music publishers, and groups of artists have filed lawsuits challenging this practice as copyright infringement. The legal questions are genuinely unsettled — fair use doctrine was not designed for AI training at scale.
🔑 Style vs. Expression
Copyright law has traditionally not protected style — you can paint in the manner of Vermeer without permission. But AI models trained on thousands of an artist's images can produce outputs closer to their specific expression than the style/expression distinction was designed to handle. Courts are being asked to determine whether systematic training-data use at scale is transformative fair use or something else.
Generative AI and the Music Industry
In April 2023, a viral track called "Heart on My Sleeve" surfaced online using AI-cloned voices of Drake and The Weeknd, created by a user named Ghostwriter977. Universal Music Group had it taken down within days, citing copyright and personality rights. The track had over 600,000 streams before removal. The event forced an industry reckoning: voice cloning technology was already consumer-accessible; the rights framework for protecting an artist's voice and likeness in AI-generated content was either absent or untested.
The deeper cultural question is about the economic model underlying creative labor. If AI can generate in the style of any living artist at marginal cost, what is the market for human-created work in those styles? The answer differs by use case: for background music in commercial contexts, synthetic generation may largely displace human composition; for high-profile releases where the artist's authentic identity is itself the product, it may not. The transition between these categories is happening faster than the licensing and compensation frameworks can adapt.
🌟 The Consent Architecture Problem
The problem with AI and creative work is not that AI can generate creative output. It is that the infrastructure for compensating human creative workers — record labels, publishers, collecting societies, copyright law — was designed for a world of scarcity and reproduction, not AI generation at scale. Building consent and compensation infrastructure for this context requires deliberate design choices by platforms, policymakers, and the creative industries.
Quiz 6: AI in Art, Music, and Culture
5 questions — free, untracked, retake anytime.
🧪 Why is the style/expression distinction in copyright law under pressure from AI?
🧪 What was the structural concern about the Jason Allen AI art competition win?
🧪 What did the "Heart on My Sleeve" viral track expose?
🧪 In which domain is AI likely to most displace human creative workers?
🧪 The "consent architecture problem" in AI and creative work refers to:
Lab 6: Designing a Consent Architecture
Build a system for AI training data consent that could actually work at scale.
Lab 6 — Consent Architecture Design
You've been asked to design a consent and compensation system for AI training on creative work. The AI will challenge your proposal against the constraints of scale, enforcement, and economic viability.
- Propose a system: opt-in, opt-out, licensing collective, compensation pool, technical measures, or a combination.
- The AI will stress-test it: who enforces it? What about historical training data? How does it handle the global internet?
- Revise or defend. There is no perfect solution — the goal is to understand the tradeoffs.
Lesson 7: AI in Government and Infrastructure
Surveillance, policing, smart cities, public policy — and the democratic accountability problem when governance is algorithmic.
In January 2020, Robert Williams, a Black man in Detroit, was arrested at his home in front of his family and held for 30 hours. The basis for his arrest was a facial recognition match produced by a Michigan State Police database. The match was wrong. An officer who reviewed the match approved the arrest anyway. Williams was the first known documented case of a wrongful arrest caused by facial recognition in the United States — but the acknowledgment came only because Williams and the ACLU chose to pursue it.
The Detroit Police Department's facial recognition system was purchased from DataWorks Plus and used a database built partly from driver's license photos — images collected for entirely different purposes. No policy in the department required that arrests based on facial recognition matches receive independent verification before proceeding. The system's known error rates, which are higher for darker-skinned individuals, were not disclosed to the public.
Williams's case is documented. The undocumented cases are the structural problem: facial recognition matches used as investigative leads that produced stops, interrogations, and informal pressure that never resulted in formal charges and therefore left no paper trail. Those cases — where the system shaped police behavior without generating accountability documents — cannot be counted.
Facial Recognition: The Accountability Failure
By 2020, facial recognition technology was deployed by law enforcement in jurisdictions across the US, UK, China, and the EU with minimal regulatory oversight, limited public disclosure, and few documented accountability mechanisms. Studies consistently showed higher error rates for darker-skinned individuals — rates that compounded when algorithms were used in high-stakes identification rather than controlled settings.
Clearview AI's approach — scraping billions of publicly posted images into a law enforcement database — demonstrated that a company could build a surveillance infrastructure with nationwide scope using public data, marketed to law enforcement agencies without public deliberation. By the time public and regulatory attention arrived, the infrastructure was already deployed. The EU AI Act subsequently classified certain uses of facial recognition as unacceptable risk. Several US cities have banned police use. The federal government has not.
🔑 Deployment Before Governance
A persistent pattern in AI governance is technology deployment before policy frameworks exist to govern it. Facial recognition, predictive policing, and social media algorithms were all deployed at scale before meaningful regulatory attention. By the time governance arrives, incumbent systems have users, contracts, and constituencies — making regulation harder. The lesson for AI governance is speed: the window for shaping deployments is before scale, not after.
AI in Benefit Systems and Public Administration
Beyond policing, AI systems increasingly determine access to public benefits: welfare eligibility algorithms in the US (documented by Virginia Eubanks in "Automating Inequality"), child protective services risk scores in Pittsburgh, immigration fraud detection in the Netherlands. In each case, high-stakes decisions affecting vulnerable populations are made or significantly influenced by opaque algorithmic systems with limited appeal mechanisms.
The Netherlands case is instructive: the Dutch government's SyRI system, a benefits fraud detection algorithm, was declared unlawful by a court in 2020. The court found it violated ECHR rights to private life. Key problems: the algorithm targeted low-income areas and ethnic minority communities disproportionately; its criteria were secret; and people targeted had no meaningful ability to contest the score that triggered investigation. The same substantive problems — targeting, opacity, lack of appeal — appear across most AI benefit-determination deployments studied to date.
🌟 The Opacity-Power Correlation
A consistent pattern in AI governance: the systems with least transparency tend to be those deployed against populations with least power. Benefit fraud detection, child welfare risk scoring, and predictive policing all target populations — low-income, minority, justice-involved — who lack the institutional resources to contest opaque algorithmic decisions. Designing accountability for algorithmic public administration is not optional; it is foundational to democratic legitimacy.
Quiz 7: AI in Government and Infrastructure
5 questions — free, untracked, retake anytime.
🧪 What made Robert Williams's case structurally significant beyond the individual wrongful arrest?
🧪 What was the core problem with the Dutch SyRI benefits fraud system?
🧪 What does "deployment before governance" mean as a pattern in AI?
🧪 The opacity-power correlation in algorithmic governance refers to:
🧪 What did Clearview AI demonstrate about the infrastructure of surveillance?
Lab 7: Building an AI Accountability Framework
Design the accountability structure that should have existed before Robert Williams was arrested.
Lab 7 — AI Accountability Architecture
You're designing the mandatory accountability framework for any law enforcement AI system in your jurisdiction. The AI will stress-test your proposal against operational realities and legal constraints.
- Propose the core elements: what must be disclosed, what auditing is required, what appeal mechanisms must exist, and what uses should be prohibited.
- The AI will present the law enforcement and vendor counterarguments.
- Revise or defend your framework.
Lesson 8: Global AI Landscape
US/China/EU AI strategies, geopolitical stakes, access inequality — and the decisions being made now that will shape the world you inherit.
In October 2022, the Biden administration enacted the most sweeping export controls in American history — restricting sales of advanced semiconductors and chipmaking equipment to China. The decision was made by executive action, without congressional legislation, by a small interagency group. Its stated rationale was that advanced AI capability is dual-use military technology: systems trained to generate fluent text are also systems that can generate deceptive propaganda; systems that optimize protein structures are systems that can optimize bioweapon components; systems that improve surveillance can improve military targeting.
The export controls had immediate effects: Chinese AI companies scrambled for alternative chip sources; Nvidia lost a significant revenue stream; allies in Japan, South Korea, and the Netherlands were pressured to align with US restrictions. The controls also had a structural message: the US government had determined that AI leadership and national security were inseparable, and that maintaining an advantage in frontier AI was a strategic priority equivalent to nuclear or missile technology in previous eras.
This is the geopolitical context in which every AI system you use was built. The models, the chips, the data centers — they exist inside an emerging great-power competition over which country, which system of governance, and which values will shape the AI infrastructure that the next century runs on.
Three Models of AI Development
The US, China, and EU have produced distinct AI development models reflecting different relationships between state, market, and individual rights. The US model relies on private investment with selective government intervention for national security and, increasingly, competition policy. The EU model prioritizes rights protection and risk-based regulation, creating mandatory requirements for high-risk AI applications and prohibiting certain uses outright. The Chinese model integrates AI development with state industrial policy, surveillance infrastructure, and content control — producing rapid capability development and domestic deployment at scale, with limited constraint on government use cases.
🔑 Values Embedded in Infrastructure
AI systems are not neutral tools. The values of the system that produced them — about privacy, free expression, state authority, individual rights — are embedded in their design. Countries or institutions that adopt AI systems built by others are also importing the values architecture those systems embody. This is not theoretical; it is why the EU requires data localization and the US restricts Chinese AI in government systems.
Access Inequality and the Global South
The Global South is largely absent from frontier AI development. Training large models requires compute concentrations that exist primarily in the US and China — and increasingly, among a handful of cloud providers. The datasets shaping model behavior reflect primarily English-language, Western-context training data, producing models that perform meaningfully worse for other languages, cultural contexts, and knowledge domains.
Nations without domestic AI infrastructure face a choice: adopt foreign AI systems with embedded values and potential surveillance capabilities, build capability domestically at substantial cost and with significant lag, or accept a capability gap in an increasingly AI-mediated economy. The political economy of this choice is constrained by debt, infrastructure deficits, and the asymmetric bargaining power between frontier AI developers and the governments seeking to use their products.
🌟 The Infrastructure Is the Policy
In the 19th century, control of railway and telegraph networks was a geopolitical asset. In the 20th century, it was satellite and submarine cable networks. In the 21st century, it is AI training infrastructure, semiconductor supply chains, and cloud architecture. The countries and companies that own that infrastructure make the rules — not because they declare them, but because the infrastructure embeds them. This is why the export control debate is a values debate, not just a security debate.
You are inheriting an AI landscape shaped by decisions that were made before you could vote, by a small number of engineers and executives and policymakers, largely without public deliberation. The semiconductor export controls, the training data decisions, the corporate structures that concentrated AI capability in a handful of companies — these are not natural features of the world. They are choices, and choices can be contested, changed, or unmade by people who understand what they mean.
The most important capacity this module has tried to build is not technical. It is political: the ability to see AI deployment not as neutral infrastructure but as choices, embedded in systems, made by people with interests, that can be evaluated, contested, and redesigned. That is not cynicism. It is the foundation of democratic participation in a world shaped by AI.
Quiz 8: Global AI Landscape
5 questions — free, untracked, retake anytime.
🧪 What was the stated rationale for the 2022 US semiconductor export controls to China?
🧪 Which best describes the EU's AI governance model?
🧪 Why are AI systems not "neutral tools" for the countries that adopt them?
🧪 What choice does a Global South nation face regarding AI infrastructure?
🧪 The lesson's claim that "the infrastructure is the policy" means:
Lab 8: Geopolitical Scenario Analysis
Work through the competing interests in a real AI geopolitics scenario.
Lab 8 — AI Geopolitics: A Scenario Analysis
The AI will present a geopolitical AI scenario — a policy decision with competing interests from multiple countries and stakeholders. Your job is to analyze the competing interests, predict likely outcomes, and propose what you think the better decision is.
- The AI will describe the scenario and stakeholders.
- Analyze: who benefits, who is harmed, what are the second-order effects?
- Propose: what policy would you recommend, and why?
Module 2 Test: AI in Our World
15 questions covering all 8 lessons — free, untracked, retake anytime.
1. What is the core mechanism of most recommendation systems?
2. Facebook's recommendation algorithm amplified outrage because:
3. "Desirable difficulty" in learning means:
4. Alexandra Chouldechova proved that when group base rates differ:
5. "Shortcut learning" in medical AI means:
6. DeepMind's decision to make AlphaFold predictions freely available was primarily:
7. Research on generative AI's productivity impact on knowledge workers consistently shows:
8. What determines who captures AI productivity gains?
9. Why is copyright law's style/expression distinction under pressure from AI?
10. What did the "Heart on My Sleeve" viral track expose about the music industry?
11. What was structurally significant about Robert Williams's wrongful arrest?
12. The opacity-power correlation in algorithmic governance means:
13. The 2022 US semiconductor export controls to China were justified primarily as:
14. What does "the infrastructure is the policy" mean in AI geopolitics?
15. The "accountability gap" in algorithmic governance arises because: