Intro
L1
Β·
Quiz
Β·
Lab
L2
Β·
Quiz
Β·
Lab
L3
Β·
Quiz
Β·
Lab
L4
Β·
Quiz
Β·
Lab
Module Test
AI Careers & Research Β· Introduction

Every transformative technology creates a generation of specialists nobody had trained to be

This course maps the territory so you can choose your place in it deliberately

In 1876, the year Alexander Graham Bell patented the telephone, no such thing as a "telephone engineer" existed. By 1910, American Bell employed more than 100,000 people in roles that had not had names a decade earlier β€” switchboard operators, line technicians, exchange managers, traffic analysts. The jobs did not wait for universities to invent curricula. People arrived from adjacent fields β€” telegraph operators, electricians, even schoolteachers β€” and improvised their credentials as the industry expanded beneath them. The pattern was disorienting for individuals and breathtaking in aggregate: a single invention restructured the labor market within a single working lifetime.

The same restructuring is visibly underway in artificial intelligence. Between 2012 β€” when AlexNet demonstrated deep learning's practical power at ImageNet β€” and 2024, the number of AI-related job postings on LinkedIn grew by over 74% annually in some quarters. OpenAI, founded in 2015 with roughly 130 employees, employed more than 1,700 by early 2024. Google DeepMind, Anthropic, Mistral, Cohere, Hugging Face, and dozens of enterprise AI teams are all hiring simultaneously for roles whose titles did not exist when most of their managers graduated. The telephone parallel is not metaphorical β€” it is structural.

This course is a map, not a guarantee. It covers the major career tracks in AI β€” research, engineering, product, policy, and applied roles β€” and grounds each in what practitioners actually do, what they earn, and what backgrounds they come from. It will not predict which roles will still exist in five years; nobody can. What it can do is give you enough situational awareness to make deliberate choices rather than reactive ones β€” to navigate the restructuring rather than be sorted by it.

AI Careers & Research Β· Module 1 Β· Lesson 1

What Does the AI Job Market Actually Look Like?

Scale, structure, and the gap between headlines and hiring realities
Where exactly are AI jobs being created β€” and by whom?

In January 2023, Microsoft announced a $10 billion investment in OpenAI and, within weeks, posted more than 200 AI-related job listings ranging from principal research engineers at $300,000+ to AI policy analysts and prompt engineers β€” a title that did not appear in any job database before 2021. The listings attracted hundreds of thousands of applications. What made the moment instructive was not the money but the variety: Microsoft was not hiring one kind of AI worker. It was hiring across a spectrum from pure mathematics to public affairs, signaling that the AI economy was already far more differentiated than public discourse suggested.

That differentiation is the subject of this lesson. The AI job market is not a monolith. It has distinct layers, each with different educational requirements, compensation structures, and growth trajectories. Understanding those layers is the prerequisite for everything that follows in this course.

The Scale of the Market

Stanford's AI Index, published annually by the Human-Centered AI Institute, tracks AI labor market trends across major economies. The 2024 edition documented that AI-related job postings in the United States grew from roughly 1.7% of all job listings in 2016 to 4.5% in 2023 β€” a share that sounds modest until you consider that the US labor market comprises approximately 150 million workers. At 4.5%, that represents roughly 6.75 million job postings annually with an AI component, though "AI component" ranges from "must have ChatGPT familiarity" to "must have published at NeurIPS."

The LinkedIn Economic Graph team reported in 2023 that AI skills were among the fastest-growing on the platform, with members adding AI-related skills to profiles at a rate 25 times higher than in 2016. That signal is noisy β€” self-reported skills are unreliable β€” but the direction is clear. Demand for AI competency has diffused from specialist roles into general professional practice.

4.5%
US job postings with AI component (2023)
25Γ—
Growth in AI skills on LinkedIn profiles since 2016
$185k
Median ML engineer comp, US (2024 Levels.fyi)
74%
Annual growth in AI postings, peak quarters 2022–23

Three Distinct Layers

The AI labor market stratifies into three broad layers that rarely compete for the same candidates.

Layer 1 β€” Frontier Research
Roles at labs like DeepMind, Anthropic, OpenAI, Meta FAIR, and Google Brain (now folded into DeepMind). Work involves publishing novel architectures, training large models, and advancing the state of knowledge. Typically requires a PhD or equivalent research record. Highly competitive; DeepMind received over 20,000 applications for roughly 100 research scientist openings in 2022.
$250k–$600k+total comp (US, senior)
Layer 2 β€” Applied Engineering
ML engineers, data scientists, AI product engineers at companies deploying AI in products. Work involves fine-tuning models, building inference pipelines, integrating APIs, and scaling systems. Requires strong software engineering plus ML fundamentals. This is the largest layer by headcount β€” companies from fintech to healthcare to retail are all hiring here.
$130k–$250ktotal comp (US, mid-level)
Layer 3 β€” AI-Adjacent Roles
AI product managers, AI ethicists, AI policy analysts, prompt engineers, AI trainers, and domain experts (legal, medical, financial) who shape, govern, or oversee AI systems. Growing faster than either of the first two layers in percentage terms. Backgrounds vary enormously β€” law, journalism, social science, and domain expertise are all represented.
$80k–$180ktotal comp (US, varies widely)

Geography and Concentration

AI employment remains geographically concentrated despite remote work's expansion. The Stanford AI Index 2024 identified the San Francisco Bay Area, Seattle, New York City, London, and Beijing as the five largest AI employment hubs by absolute count. The Bay Area alone accounts for roughly 30% of US AI job postings requiring advanced ML skills, driven by the density of frontier labs and large tech companies.

However, a meaningful second tier has emerged. Austin, Toronto, Montreal, Boston, Paris, and Singapore all host significant AI research and engineering clusters. Montreal's rise is partly attributable to Yoshua Bengio's Mila institute and favorable immigration policy; Toronto's to the Vector Institute founded in 2017 with government backing. These second-tier cities often offer lower costs of living with comparable technical communities, which matters for early-career decisions.

The remote vs. in-person divide in AI hiring is sharper than in most tech fields. Frontier research labs have largely resisted full remote arrangements β€” DeepMind's London and Mountain View offices require significant in-person presence β€” while applied engineering roles have proven more flexible. Policy and product roles vary by company culture.

Market Signal

According to Lightcast (formerly EMSI Burning Glass), the number of unique AI job titles in US job postings grew from approximately 400 in 2019 to over 1,200 in 2023. Title proliferation of this kind historically indicates an industry in active self-organization β€” it doesn't yet know what it needs, so it's trying everything.

Who Is Actually Getting Hired?

A recurring misconception is that AI careers require computer science PhDs. The data is more nuanced. A 2023 analysis of 10,000 AI job postings by Indeed's Hiring Lab found that roughly 35% required a graduate degree, 50% required a bachelor's degree, and 15% listed no degree requirement at all β€” the last category growing fastest. The 35% requiring graduate degrees were concentrated almost entirely in Layer 1 and upper Layer 2.

What postings did require, consistently, was demonstrated competency: GitHub repositories, Kaggle rankings, published work, or prior professional experience with specific tools. Credentials remain important for laboratory research positions; for applied and adjacent roles, portfolios and demonstrated output increasingly substitute for formal degrees.

The most in-demand technical skills across all layers, per LinkedIn's 2024 Future of Work report, were: Python programming, familiarity with transformer architectures, experience with cloud ML platforms (AWS SageMaker, Google Vertex AI, Azure ML), and β€” increasingly β€” experience with large language model APIs and fine-tuning pipelines.

The Underappreciated Layer

Layer 3 β€” AI-adjacent roles β€” is the fastest-growing segment in percentage terms and the least discussed in popular coverage. When Scale AI raised $1 billion in 2021, it was partly to fund a workforce of tens of thousands of human annotators, trainers, and quality reviewers β€” a workforce that spans the globe and requires domain expertise (medical, legal, linguistic) far more than coding ability. The infrastructure of AI is, in large part, human.

Key Terms

ML EngineerBuilds, trains, and deploys machine learning models in production environments; bridges research and software engineering.
AI ResearcherDevelops novel algorithms or architectures, typically publishing results; concentrated in frontier labs and universities.
AI Product ManagerDefines what AI-powered products should do, translates technical capabilities into user value, owns roadmap decisions.
Prompt EngineerDesigns, tests, and optimizes natural language instructions to elicit desired behavior from large language models; emerged as a formal role circa 2022.
AI Safety ResearcherInvestigates alignment, robustness, and interpretability of AI systems to reduce risks from deployment; growing sub-field with dedicated labs and funding.

Lesson 1 Quiz

What Does the AI Job Market Actually Look Like?
1. According to the Stanford AI Index 2024, approximately what share of US job postings had an AI component in 2023?
Correct. The Stanford AI Index 2024 reported that AI-related job postings grew to roughly 4.5% of all US listings by 2023, up from 1.7% in 2016.
Not quite. The Stanford AI Index 2024 found roughly 4.5% of all US job postings had an AI component in 2023.
2. Which of the following best describes "Layer 1" in the AI labor market's three-layer structure?
Correct. Layer 1 refers to frontier research roles β€” typically PhD-level scientists at labs like DeepMind, Anthropic, OpenAI, and Meta FAIR β€” whose work involves advancing the state of knowledge and publishing results.
Not quite. Layer 1 is frontier research at organizations like DeepMind, Anthropic, and OpenAI β€” the smallest layer by headcount but the most technically demanding.
3. What was the primary catalyst for Montreal becoming a major AI employment hub?
Correct. Montreal's rise as an AI cluster is substantially attributable to the Mila Quebec AI Institute, anchored by Yoshua Bengio, combined with immigration policies that made it easier to attract international AI talent.
The primary drivers were Yoshua Bengio's Mila institute β€” one of the world's leading AI research centers β€” and Canadian immigration policy that facilitated attracting international researchers.
4. According to Indeed's Hiring Lab analysis of 10,000 AI job postings in 2023, what percentage required a graduate degree?
Correct. Roughly 35% of AI job postings required a graduate degree, 50% required a bachelor's, and 15% listed no degree requirement β€” with the no-degree category growing fastest.
Indeed's Hiring Lab found roughly 35% of AI job postings required a graduate degree β€” higher than general tech, but lower than many assume, with the no-degree category growing fastest.
5. Which US metro area accounted for approximately 30% of AI job postings requiring advanced ML skills?
Correct. The San Francisco Bay Area, driven by the density of frontier labs and major tech companies, accounts for roughly 30% of US AI job postings requiring advanced ML skills.
The San Francisco Bay Area leads by a substantial margin, driven by the concentration of frontier labs (OpenAI, Anthropic, Google DeepMind's US offices) and large tech employers.

Lab 1 β€” Mapping Your Layer

AI Career Landscape Β· Conversation Practice

What you'll do

You'll have a focused conversation with an AI advisor about where you might fit in the three-layer AI labor market. Come with a sense of your background β€” technical or non-technical β€” and the advisor will help you think through which layer's roles align with your current skills and trajectory.

Complete at least 3 exchanges to finish this lab.

Suggested opener: "I have a background in [your field]. Which AI career layer makes the most sense for me to explore first, and why?"
AI Career Advisor
Lab 1
Welcome. I'm here to help you think through where you fit in the AI job market's three-layer structure β€” frontier research, applied engineering, or AI-adjacent roles. Tell me about your background: what have you studied or worked in so far, and what draws you to AI careers?
AI Careers & Research Β· Module 1 Β· Lesson 2

Research Careers: What Labs Actually Do

Inside the organizations advancing AI knowledge β€” and what it takes to work there
What separates a research scientist at DeepMind from a research engineer at a startup?

In 2017, eight researchers left Google Brain to found OpenAI's safety team, and within a year, two of them β€” Paul Christiano and Dario Amodei β€” had published work on reinforcement learning from human feedback (RLHF) that would, five years later, underpin the training of ChatGPT. They were not following a career path that existed in 2010; they were constructing one in real time. The trajectory illustrates something important: research careers in AI are defined less by institutions than by problems. The researchers who most shaped the last decade moved fluidly between Google, academia, and new labs, following the questions that interested them.

The Research Org Landscape

AI research of consequence happens in four kinds of institutions, each with distinct cultures and constraints.

Industrial Labs
DeepMind, OpenAI, Anthropic, Meta FAIR, Google Brain (now DeepMind), Microsoft Research. Access to compute that no university can match. Publication encouraged but product pressures are real. DeepMind published 1,000+ papers in 2023 while simultaneously shipping Gemini. Culture varies β€” OpenAI is more product-oriented than Meta FAIR, which operates closer to an academic department.
$250k–$600k+senior research scientist, US
University Labs
MIT CSAIL, Stanford HAI, Berkeley BAIR, CMU ML, Toronto Vector, Montreal Mila. Maximum academic freedom; minimal compute relative to industrial labs. Publication is primary metric. Most frontier researchers trained here before moving to industry. Some, like Yoshua Bengio, have remained and built institutes that attracted industry partnerships without leaving academia.
$80k–$180kpostdoc to full professor range
Nonprofits & Institutes
Allen Institute for AI (Ai2), Redwood Research, ARC (Alignment Research Center), MIRI. Mission-driven; often focused on safety, interpretability, or open research. Compensation below industrial labs but above most academic positions. Ai2, founded by Paul Allen in 2014, employs ~200 researchers and has produced significant NLP benchmarks including SQuAD and AllenNLP.
$130k–$220kresearcher, US, varies by org
Government & National Labs
DARPA, National AI Initiative labs, NIST, Sandia National Laboratories, UK DSIT, EU AI labs. Long time horizons, stable funding, but slower hiring and lower pay than industry. DARPA funded foundational AI work for decades β€” the internet, GPS, and many early ML programs trace DARPA funding. Growing AI-specific mandates since the 2021 National AI Initiative Act.
$90k–$160kresearcher, US government scale

Research Scientist vs. Research Engineer

The distinction matters enormously for hiring. Most industrial labs maintain a strict two-track system:

Research Scientists are expected to generate novel ideas and publish. The job is closer to academic research than engineering β€” literature review, hypothesis formation, experiment design, paper writing. At DeepMind, research scientists have the title from the first day; they are hired for intellectual output, not implementation. A strong publication record at top venues (NeurIPS, ICML, ICLR, ACL, CVPR) is effectively required.

Research Engineers implement ideas at scale. They write the infrastructure that lets research scientists run 10,000-GPU training runs. They build evaluation frameworks, maintain codebases, and optimize for reproducibility. The role requires serious software engineering skill on top of ML knowledge. Research engineers at Meta FAIR and Google DeepMind are among the best-compensated engineers in the industry β€” their work is what makes the research possible.

Publication Record as Currency

At frontier labs, a researcher's publication record at top-tier venues functions like a credit score β€” it determines what roles you can access. NeurIPS 2023 received over 12,000 paper submissions and accepted roughly 26%. A first-author acceptance at NeurIPS, ICML, or ICLR is a meaningful signal. Multiple such publications, especially at top labs or universities, open doors that do not otherwise open. This is one of the clearest cases in the job market where credentials β€” specifically the right credentials β€” are load-bearing.

The PhD Question

The research track is one of the few AI career paths where a PhD remains near-mandatory for senior roles. But the mechanics have shifted. In 2015, a PhD from a top ML program typically led to a faculty position first, then industry. By 2023, the majority of PhD graduates from CMU, Stanford, and Berkeley ML programs went directly to industry labs β€” often with offers before defending their dissertation.

The incentive has reversed: industry labs now offer better compute access, higher pay, and faster iteration cycles than most academic positions. Geoffrey Hinton left Google in 2023, but he was an exception β€” most traffic flows the other direction. The consequence is that academic labs are training researchers who immediately leave, creating ongoing tension about who funds graduate training and who captures the output.

For those without a PhD who want research roles, a narrow path exists through demonstrated independent research: open-source contributions to major frameworks (PyTorch, Hugging Face Transformers), preprints on arXiv that attract citations, or winning competitive benchmarks (HELM, BIG-bench, MLPerf). This path is real but uncommon; the lesson is not that it is closed, but that it requires building an equivalent signal to what a PhD provides.

A Structural Oddity

Several of the most impactful researchers at frontier labs β€” including key contributors to transformer architecture research β€” never completed traditional PhD programs or entered industry through unconventional routes. The field is young enough that credential inflation hasn't fully set in at the top end. What this means practically: exceptional demonstrated research output can still substitute for formal credentials, though the bar is high and rising.

Key Terms

Research ScientistGenerates novel research, publishes at peer-reviewed venues; primary output is intellectual contribution rather than production code.
Research EngineerImplements research at scale; builds infrastructure, training pipelines, and evaluation systems that enable research scientists to work.
RLHFReinforcement Learning from Human Feedback β€” training technique central to aligning large language models; developed at OpenAI and published in 2017–2020.
NeurIPSNeural Information Processing Systems β€” one of the most prestigious annual AI research conferences; acceptance is a primary career signal in ML research.
Preprint (arXiv)A research paper posted publicly before peer review; in fast-moving AI research, arXiv preprints often circulate widely before formal publication.

Lesson 2 Quiz

Research Careers: What Labs Actually Do
1. What technique did Paul Christiano and Dario Amodei help develop that later underpinned ChatGPT's training?
Correct. Paul Christiano (along with collaborators) developed RLHF at OpenAI, and Dario Amodei was research VP at OpenAI during key development periods. RLHF became the core alignment technique for InstructGPT and ChatGPT.
The technique was RLHF β€” Reinforcement Learning from Human Feedback β€” which emerged from OpenAI research and became the core training method behind ChatGPT's alignment.
2. What distinguishes a Research Scientist from a Research Engineer in industrial AI labs?
Correct. The two-track system at most frontier labs separates intellectual output (research scientists) from implementation infrastructure (research engineers), though both roles require deep ML knowledge.
The key distinction is output type: research scientists generate novel research and publish; research engineers build the infrastructure that makes large-scale experiments possible.
3. How many paper submissions did NeurIPS 2023 receive, and what was the approximate acceptance rate?
Correct. NeurIPS 2023 received over 12,000 submissions and accepted roughly 26% β€” making it both the largest and one of the more selective venues in AI research.
NeurIPS 2023 received over 12,000 submissions with roughly a 26% acceptance rate β€” high volume, but selective enough that an acceptance carries meaningful career signal.
4. Which institution did Yoshua Bengio anchor that helped establish Montreal as a major AI research hub?
Correct. Yoshua Bengio co-founded and directs Mila, the Quebec AI Institute, which has become one of the world's largest academic AI research centers and a primary driver of Montreal's AI cluster.
The institution is Mila β€” the Quebec AI Institute β€” founded and directed by Yoshua Bengio, one of the "godfathers" of deep learning and 2018 Turing Award co-winner.
5. What major trend occurred in PhD graduate career paths between 2015 and 2023?
Correct. By 2023, the majority of ML PhD graduates from top programs went directly to industry labs, attracted by better compute access, higher pay, and faster iteration cycles than academic positions offer.
The key shift is that most ML PhD graduates now go directly to industry labs rather than faculty positions, reversing the pattern of a decade ago when academia was the primary first destination.

Lab 2 β€” Research Role Explorer

AI Research Careers Β· Conversation Practice

What you'll do

Use this conversation to explore the research career path in depth. Ask about specific organizations, the PhD question for your situation, how to build a publication record from scratch, or what separates a research scientist role from a research engineer role in practice.

Complete at least 3 exchanges to finish this lab.

Suggested opener: "I want to understand what a realistic path into an AI research role looks like given my current background. Can you walk me through it?"
AI Research Career Advisor
Lab 2
I can help you map a realistic path into AI research. The route differs substantially depending on whether you're aiming for research scientist roles (which typically require a PhD and publications), research engineer roles (which weight software engineering and ML implementation), or nonprofit/government research (which have different criteria again). What's your starting point β€” academic, industry, or somewhere else?
AI Careers & Research Β· Module 1 Β· Lesson 3

Engineering & Product Roles: Where Most AI Work Happens

The large middle layer β€” how AI gets built, deployed, and turned into products
What do ML engineers and AI product managers actually do all day?

When Spotify launched its "Discover Weekly" playlist feature in July 2015, it was powered by a collaborative filtering model built by a team of ML engineers and data scientists β€” none of whom were researchers by title. Within six months, Discover Weekly had been used by 40 million people, with users streaming over 5 billion tracks through it. The system was not novel research; it was careful implementation of known techniques β€” matrix factorization, implicit feedback signals β€” applied to a specific product problem. The engineers who built it did not publish papers. They shipped a feature that changed how 40 million people found music. That is the work of Layer 2.

Machine Learning Engineer

The ML engineer role is the largest single AI job category by headcount. According to Levels.fyi's 2024 compensation database, there are more ML engineer postings at large tech companies than any other AI-specific title. The role sits at the intersection of software engineering and machine learning, and it encompasses a wide range of actual work depending on company and team:

Training and fine-tuning models β€” taking a foundation model (GPT-4, Llama 3, Gemini) and adapting it to a company's specific use case through fine-tuning, RLHF, or prompt engineering at scale. This is increasingly common as foundation models commoditize.

Building inference infrastructure β€” model deployment is an engineering problem distinct from model training. Low-latency serving, A/B testing frameworks, model versioning, monitoring for drift, and cost optimization of GPU compute are all ML engineering concerns that require systems engineering knowledge.

Feature engineering and data pipelines β€” in companies where custom models still matter, the quality of training data is often the primary bottleneck. ML engineers own the data ingestion, cleaning, and labeling pipelines that feed models.

What ML Engineers Actually Use

LinkedIn's 2024 Future of Work report identified the most-cited tools in ML engineer job postings: Python (98% of postings), PyTorch (71%), TensorFlow (48%), Kubernetes (44%), SQL (62%), and β€” rising sharply β€” the OpenAI API and Hugging Face ecosystem (up from negligible in 2021 to 55% of postings by 2024). The shift toward API-based development is structural: many companies no longer train models from scratch and instead orchestrate foundation models.

Data Scientist

Data scientist is an older title than ML engineer and encompasses a broader range of work. The role was popularized after a 2012 Harvard Business Review article called it "the sexiest job of the 21st century" β€” written by Thomas Davenport and D.J. Patil, who had been Chief Data Scientist at the US Office of Science and Technology Policy under President Obama.

In practice, data scientist roles range from essentially statistical analysis and BI (business intelligence) to full ML model development. The ambiguity is a known issue: a 2023 survey by O'Reilly found that 60% of data scientists reported spending more than half their time on data cleaning and preparation rather than modeling. The title is less precise than ML engineer and carries more variation in what it actually requires.

AI Product Manager

The AI PM role emerged as a distinct specialization around 2018–2019, as companies building AI-powered products found that traditional product management skills were insufficient. Standard PM work β€” user research, roadmap prioritization, stakeholder management β€” is still required. But AI PMs also need to:

Understand model capabilities and limitations β€” knowing when a model will hallucinate, what kinds of tasks it handles well, and how to set user expectations appropriately is prerequisite knowledge, not optional background.

Navigate evaluation and iteration cycles β€” AI products don't iterate the same way software products do. Changing a model changes behavior in non-deterministic ways. PMs need frameworks for evaluating model-based features that differ from standard A/B testing.

Manage data requirements β€” most AI product decisions are constrained by data: what's available, what's labeled, what's legally usable. AI PMs work closely with data teams in ways traditional PMs do not.

The compensation for AI PM roles at major tech companies is comparable to ML engineers at similar seniority levels. A principal AI PM at Google, Meta, or Microsoft commands total compensation of $250,000–$400,000, driven by the shortage of people who understand both product development and ML systems.

Prompt Engineer
Designs and optimizes natural language instructions to LLMs for production use. Emerged as a formal role circa 2022. Anthropic posted one of the first formal "Prompt Engineer" listings at $250,000–$335,000 in early 2023. Whether the role stabilizes or is absorbed into other functions remains debated β€” but current demand is real.
$130k–$335kwide range by company and seniority
MLOps Engineer
Manages the operational infrastructure of ML systems β€” CI/CD for models, monitoring, experiment tracking, feature stores. Emerged from DevOps as ML systems matured. Tools include MLflow, Weights & Biases, Kubeflow, and Vertex AI. Rapidly growing role as production ML deployments scale.
$140k–$230kUS, mid to senior level
AI Product Designer
UX/product design focused on AI-powered interfaces β€” how to present probabilistic outputs, manage uncertainty, design for model errors, and build trust. Growing role as AI enters consumer products. Requires understanding of both design principles and AI system behavior.
$120k–$200kUS, senior level

Breaking In Without a Research Background

Layer 2 is the most accessible entry point for career changers. The practical path involves a sequence of credential-building that takes roughly 12–24 months for someone starting from a general software engineering background:

First, develop ML fundamentals: Andrew Ng's Deep Learning Specialization on Coursera is cited in more ML engineer career retrospectives than any other single resource. Fast.ai's Practical Deep Learning for Coders offers a complementary top-down approach.

Second, build a public portfolio: Kaggle competitions provide structured problems with public leaderboards; placing in the top 10–20% on a well-known competition is a meaningful signal. Hugging Face model cards, GitHub repositories with documented experiments, and technical blog posts all contribute.

Third, target the application: companies like Netflix, Spotify, Airbnb, Stripe, and Shopify have substantial ML engineering teams with documented, structured hiring processes and are known to evaluate portfolio work seriously alongside credentials.

The Foundation Model Shift

The release of GPT-3 in 2020 and the subsequent commoditization of large language models via APIs has meaningfully changed what ML engineering involves. A growing share of ML engineering work is now orchestration and integration of existing models rather than training from scratch. This lowers some barriers to entry (less need for GPU infrastructure knowledge) while raising others (system design for AI-powered applications, prompt engineering at scale, evaluation methodology). The role is actively evolving.

Key Terms

InferenceRunning a trained model to generate predictions or outputs; distinct from training, and often the primary engineering challenge in production AI systems.
MLOpsMachine Learning Operations β€” practices and tools for deploying, monitoring, and maintaining ML models in production environments.
Feature StoreA centralized repository for storing and serving ML features (input variables) to models, enabling consistency between training and inference.
Model DriftThe degradation of model performance over time as the real-world data distribution changes from the training data distribution; a core MLOps concern.
Foundation ModelA large AI model trained on broad data at scale that can be adapted to many downstream tasks; GPT-4, Llama 3, and Gemini are examples.

Lesson 3 Quiz

Engineering & Product Roles: Where Most AI Work Happens
1. What Spotify feature, launched in 2015, is cited as a landmark example of Layer 2 applied ML work?
Correct. Discover Weekly, launched July 2015, used collaborative filtering to personalize playlists and was used by 40 million people within six months β€” a landmark applied ML product built without novel research.
The feature was Discover Weekly, launched in July 2015, which used collaborative filtering (matrix factorization) to power personalized playlists β€” a clear example of known techniques carefully applied to a product problem.
2. According to LinkedIn's 2024 data, what percentage of ML engineer job postings cited the OpenAI API or Hugging Face ecosystem?
Correct. By 2024, roughly 55% of ML engineer postings cited the OpenAI API or Hugging Face ecosystem β€” up from negligible in 2021, reflecting the shift toward API-based AI development.
The figure was about 55%, up from negligible in 2021 β€” one of the clearest signals of the structural shift toward orchestrating foundation models rather than training from scratch.
3. Who wrote the 2012 Harvard Business Review article that called data scientist "the sexiest job of the 21st century"?
Correct. Thomas Davenport and D.J. Patil wrote the article; Patil later served as Chief Data Scientist at the US Office of Science and Technology Policy under President Obama.
The authors were Thomas Davenport and D.J. Patil. Patil is notable for having served as the first US Chief Data Scientist under President Obama.
4. What salary range did Anthropic post for one of the first formal "Prompt Engineer" listings in early 2023?
Correct. Anthropic's early 2023 prompt engineer posting listed $250,000–$335,000, signaling that the role commands frontier-level compensation and is taken seriously as a distinct specialization.
Anthropic's listing was $250,000–$335,000 β€” a notably high range that reflected both the scarcity of qualified candidates and the strategic importance of prompt quality to model-based products.
5. What is "model drift" in the context of deployed ML systems?
Correct. Model drift refers to performance degradation when the real-world data a model encounters in production diverges from the data it was trained on β€” a core concern in MLOps and production system maintenance.
Model drift is the performance degradation that occurs when the distribution of real-world inputs shifts away from the training data distribution β€” a key reason production ML systems require ongoing monitoring.

Lab 3 β€” Role Comparison Workshop

Engineering & Product Roles Β· Conversation Practice

What you'll do

Use this conversation to compare specific engineering and product roles β€” ML engineer vs. data scientist, MLOps vs. research engineer, AI PM vs. traditional PM. Ask about day-to-day responsibilities, required skills, and how to position yourself for a role transition.

Complete at least 3 exchanges to finish this lab.

Suggested opener: "I'm trying to decide between ML engineer and AI product manager. Can you help me understand which fits better with a background in software engineering and business analysis?"
AI Role Advisor
Lab 3
Happy to help you compare roles. The ML engineer vs. AI PM distinction is one of the most important in the field β€” they require different skill sets, attract different backgrounds, and have different day-to-day experiences even at the same company. Let's start with your current skills: are you more comfortable writing code and thinking about model behavior, or defining product requirements and working across functions?
AI Careers & Research Β· Module 1 Β· Lesson 4

Policy, Ethics, and the Adjacent Roles Defining AI's Boundaries

The fastest-growing segment of AI employment β€” and why it matters more than its small headcount suggests
What does an AI ethicist, safety researcher, or policy analyst actually do β€” and who hires them?

In December 2020, Google fired Timnit Gebru, a prominent AI ethics researcher and co-lead of its Ethical AI team, after she submitted a paper β€” later published at FAccT 2021 as "On the Dangers of Stochastic Parrots" β€” that critiqued the environmental cost and bias risks of large language models. The dismissal, and the subsequent departure of co-lead Margaret Mitchell, drew intense attention to a question the industry had not seriously answered: who inside AI companies is actually empowered to constrain what those companies build? Gebru's case made visible a structural tension that remains unresolved. The people tasked with identifying risks from AI systems sometimes work for the organizations most invested in deploying them.

AI Ethics and Responsible AI

AI ethics roles have grown from a near-nonexistent category to a recognizable career track in approximately five years. The shift began around 2018, driven by public controversies β€” facial recognition bias studies, algorithmic lending discrimination, Cambridge Analytica β€” that created reputational and legal pressure on companies to address AI harm systematically.

The field draws from philosophy, sociology, computer science, law, and science and technology studies (STS). Practitioners typically combine domain knowledge with technical familiarity β€” enough to understand model behavior without necessarily training models. Major employers include the Responsible AI teams at Google, Microsoft, Amazon, and Meta, as well as independent organizations like the AI Now Institute (NYU), Partnership on AI, and the Algorithmic Justice League founded by Joy Buolamwini in 2016 after her MIT Media Lab research documented facial analysis disparities across skin tones.

The Structural Problem

Multiple researchers have documented what Timnit Gebru's case illustrated: AI ethics teams inside product companies face inherent conflicts of interest. A 2023 Nature paper by Bender, Raji, and colleagues reviewed 50 prominent AI ethics controversies and found that in 38 cases, the internal ethics function had raised concerns before the controversy became public β€” and been overruled. The question of where ethics authority should sit inside or outside companies is a live policy debate.

AI Safety Research

AI safety is a distinct technical research field concerned with ensuring AI systems behave reliably, predictably, and in alignment with human intentions. It differs from AI ethics in being primarily a technical rather than normative discipline β€” safety researchers develop formal methods, interpretability tools, and alignment techniques rather than primarily making policy recommendations.

The field has grown substantially since 2021. The Center for AI Safety (CAIS), the Machine Intelligence Research Institute (MIRI), and Redwood Research focus specifically on safety. Anthropic, which was founded by former OpenAI researchers including Dario and Daniela Amodei explicitly around safety concerns, employs hundreds of safety researchers. DeepMind's safety team, led by researchers including Shane Legg (a co-founder), has published significant work on agent evaluation and scalable oversight.

Compensation in safety research has risen sharply as labs compete for a small pool of qualified researchers. Entry-level safety researchers at Anthropic or OpenAI now command salaries comparable to senior ML engineers β€” reflecting scarcity more than prestige.

AI Policy

AI policy is a field that sits at the intersection of technology expertise and government process. Practitioners work in government agencies, legislative staff offices, think tanks, and the policy arms of technology companies. The role grew sharply after the European Union began drafting the EU AI Act in 2021 (it passed in March 2024), and the US Executive Order on AI in October 2023 created dozens of new federal AI policy positions.

The backgrounds that feed AI policy are diverse: law, economics, political science, public policy, and computer science all appear. What unifies successful practitioners is the ability to translate between technical capabilities and regulatory language β€” a skill that is genuinely rare. Organizations like the Georgetown Center for Security and Emerging Technology (CSET), the Future of Life Institute, and the Center for AI and Digital Policy provide fellowship and research pathways into the field.

AI Ethicist
Reviews AI systems for bias, fairness, and harm. Develops internal policies and red-lines. Works across product teams. Typically requires background in philosophy, social science, or STS with technical fluency. Roles at Google, Microsoft, Meta, and independent organizations.
$100k–$200kindustry; varies by organization type
AI Safety Researcher
Develops technical methods for alignment, interpretability, and robustness. More technical than ethics roles; PhD common but not universal. Anthropic, OpenAI, DeepMind, Redwood Research, MIRI, and CAIS are primary employers.
$150k–$400kwide range; frontier labs at high end
AI Policy Analyst
Analyzes regulatory proposals, advises legislators, writes policy briefs. Works in government, think tanks, or tech company policy teams. Law or public policy background plus technical fluency. Growing rapidly post-EU AI Act and US EO.
$80k–$180kthink tank to tech company range
AI Trainer / RLHF Contractor
Provides human feedback for model training pipelines. Ranges from general crowd work (Scale AI, Appen) to specialized expert feedback (medical, legal, coding domains). Scale AI's Remotasks platform represents the industrial scale of this category.
$15–$80/hrwide range by domain and expertise

Entering Adjacent Roles

Adjacent roles are the most accessible entry points for people coming from non-technical fields. Law graduates who understand technology regulation are genuinely scarce and in demand for AI policy roles. Social scientists with quantitative methods backgrounds are well-positioned for AI ethics research positions. Medical professionals who understand clinical workflow are increasingly sought by health AI companies for roles as clinical AI specialists or safety evaluators.

The key investment for non-technical backgrounds entering adjacent roles is developing technical fluency without technical depth β€” enough understanding of how models work, what their failure modes are, and what current research addresses to participate credibly in cross-functional conversations. The fast.ai course mentioned in Lesson 3, Stanford's Human-Centered AI initiative's free courses, and MIT's online MicroMasters in Statistics and Data Science all serve this purpose.

The field is also genuinely early. Several of today's leading AI ethicists β€” including Timnit Gebru, Joy Buolamwini, and Kate Crawford β€” built their authority through research output (papers, books, documented audits) rather than institutional credentials. The Algorithmic Justice League, AI Now Institute, and Data & Society were all founded by people who constructed the field as they worked in it. That generative quality hasn't entirely disappeared.

A Field Still Defining Itself

There is no standard credential for AI ethics, policy, or safety. Universities are actively building programs β€” MIT, Oxford's Future of Humanity Institute (now restructured as Oxford Martin AI Governance Initiative), Johns Hopkins, and Carnegie Mellon all have formal programs β€” but the field is moving faster than curriculum committees. In practice, demonstrated work β€” audits, policy papers, interpretability research β€” functions as the primary credential. This is simultaneously a barrier (no clear path) and an opportunity (output matters more than pedigree).

Key Terms

Algorithmic AuditA systematic examination of an AI system's outputs or behavior for bias, fairness violations, or unintended discrimination; a core tool in AI ethics practice.
InterpretabilityThe degree to which a model's internal workings can be understood by humans; a key safety research concern for high-stakes deployments.
EU AI ActThe European Union's regulatory framework for AI, passed March 2024, which classifies AI systems by risk level and imposes obligations on developers and deployers accordingly.
Red-teamingAdversarial testing of AI systems to identify failure modes, harmful outputs, or security vulnerabilities before deployment; a practice growing rapidly across labs.
AlignmentThe technical challenge of ensuring AI systems pursue goals consistent with human values and intentions β€” the central research problem in AI safety.

Lesson 4 Quiz

Policy, Ethics, and AI-Adjacent Roles
1. What happened to Timnit Gebru at Google in December 2020, and why was it significant?
Correct. Gebru's firing after submitting "On the Dangers of Stochastic Parrots" made visible the structural tension between internal ethics functions and the commercial interests of AI product companies.
Gebru was fired by Google in December 2020 after submitting a paper critiquing large language models. The case became a landmark illustration of the conflicts AI ethics teams face inside product organizations.
2. What research by Joy Buolamwini led to the founding of the Algorithmic Justice League in 2016?
Correct. Buolamwini's research at MIT Media Lab documented that commercial facial analysis systems had significantly higher error rates for darker-skinned faces, particularly women β€” findings that directly motivated the Algorithmic Justice League.
Buolamwini documented facial analysis disparities across skin tones at MIT Media Lab, finding much higher error rates for darker-skinned individuals. This research directly motivated founding the Algorithmic Justice League.
3. When did the EU AI Act pass, and what is its primary regulatory mechanism?
Correct. The EU AI Act passed in March 2024 and uses a risk-based classification system β€” prohibited uses, high-risk systems with strict obligations, and lower-risk applications with lighter requirements.
The EU AI Act passed in March 2024. Its core mechanism is risk-based classification: AI systems are categorized by risk level, and higher-risk categories face more stringent obligations on developers and deployers.
4. How does AI safety research primarily differ from AI ethics practice?
Correct. AI safety research develops technical methods β€” alignment techniques, interpretability tools, robustness methods β€” while AI ethics practice is primarily normative, developing policies, conducting audits, and making recommendations about values and harm.
The key distinction is disciplinary: safety research is primarily technical (alignment, interpretability, robustness), while ethics practice is primarily normative (fairness analysis, policy recommendations, harm assessment).
5. A 2023 Nature paper reviewing 50 AI ethics controversies found what pattern regarding internal ethics functions?
Correct. The finding β€” that internal ethics teams raised concerns in 38 of 50 cases and were overruled β€” is the empirical basis for the ongoing debate about whether internal ethics functions are structurally equipped to constrain product decisions.
In 38 of 50 cases, internal ethics teams had raised concerns before the controversy became public and had been overruled. This finding is central to the debate about where AI ethics authority should sit.

Lab 4 β€” Policy & Ethics Career Pathfinder

Adjacent AI Roles Β· Conversation Practice

What you'll do

Use this conversation to explore AI policy, ethics, and safety career paths. Ask about how your specific background maps to these roles, what technical fluency you actually need, which organizations to target, and how the field is evolving post-EU AI Act and the 2023 US Executive Order.

Complete at least 3 exchanges to finish this lab.

Suggested opener: "I have a background in [law / social science / philosophy / journalism / other]. How do I build credibility in AI policy or ethics without a computer science degree?"
AI Policy & Ethics Advisor
Lab 4
AI policy and ethics roles are among the most accessible entry points into the field for non-technical backgrounds β€” and among the most consequential. The EU AI Act, the US Executive Order on AI, and growing corporate responsible AI teams have all created genuine demand for people who can bridge between technical systems and governance. Tell me your background and what aspect of this space interests you most β€” policy, ethics, safety research, or something else?

Module 1 Test

The AI Career Landscape Β· 15 Questions Β· 80% to pass
1. According to the Stanford AI Index 2024, US AI job postings grew from approximately 1.7% to what share of all listings between 2016 and 2023?
Correct. The Stanford AI Index 2024 documented growth from 1.7% to 4.5% of all US job postings between 2016 and 2023.
The correct figure is 4.5%, per the Stanford AI Index 2024 β€” up from 1.7% in 2016.
2. What is the primary distinguishing characteristic of Layer 1 (Frontier Research) in the AI labor market?
Correct. Layer 1 is defined by frontier research β€” novel work published at top venues β€” and typically requires a PhD or equivalent research record.
Layer 1 is frontier research: generating novel architectures and techniques, publishing at top venues, typically requiring a PhD. Layer 2 is the largest layer; Layer 3 is growing fastest in percentage terms.
3. Lightcast data showed the number of unique AI job titles in US postings grew from approximately 400 in 2019 to how many by 2023?
Correct. Lightcast (formerly EMSI Burning Glass) documented growth from ~400 to over 1,200 unique AI job titles between 2019 and 2023.
The figure is over 1,200 unique AI job titles by 2023, per Lightcast β€” a tripling in four years indicating an industry still actively defining what it needs.
4. Paul Christiano's work on RLHF was conducted while he was at which organization?
Correct. Paul Christiano developed foundational RLHF work at OpenAI before later founding the Alignment Research Center (ARC).
Christiano conducted his RLHF research at OpenAI. He later founded the Alignment Research Center (ARC), an independent safety organization.
5. At major frontier AI labs, what does a Research Engineer primarily do?
Correct. Research engineers build the systems β€” training infrastructure, evaluation frameworks, compute orchestration β€” that make large-scale research experiments possible.
Research engineers build infrastructure β€” training pipelines, evaluation systems, compute management β€” that enables research scientists to run experiments at scale. They require both ML knowledge and serious systems engineering skill.
6. Which of the following is a primary tool cited in ML engineer job postings per LinkedIn's 2024 Future of Work report?
Correct. PyTorch appeared in 71% of ML engineer postings per LinkedIn's 2024 data, second only to Python itself at 98%.
PyTorch appeared in 71% of ML engineer postings β€” behind Python (98%) but far ahead of alternatives. R, MATLAB, and Julia appeared in very few ML engineer postings.
7. Spotify's Discover Weekly, launched in July 2015, used what ML technique as its primary approach?
Correct. Discover Weekly was powered by collaborative filtering using matrix factorization and implicit feedback signals β€” established techniques carefully applied to a product problem.
Discover Weekly used collaborative filtering (matrix factorization) on implicit feedback signals β€” a well-understood technique applied carefully to a real product. It was not novel research; it was excellent engineering.
8. What is "model drift" in the context of deployed ML systems?
Correct. Model drift is the performance degradation that occurs when the real-world data distribution shifts from the training distribution β€” a core concern in production ML system monitoring.
Model drift is performance degradation caused by the gap between training data distribution and the data the model actually encounters in production β€” the primary reason production ML systems require ongoing monitoring.
9. What paper, co-authored by Timnit Gebru, triggered her dismissal from Google?
Correct. "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?" (later published at FAccT 2021) critiqued the environmental and bias risks of large language models and precipitated Gebru's dismissal.
The paper was "On the Dangers of Stochastic Parrots" β€” submitted in late 2020 and later published at FAccT 2021 β€” which critiqued the environmental costs and bias risks of large language models.
10. Which organization did Joy Buolamwini found in 2016 following her facial analysis research?
Correct. Joy Buolamwini founded the Algorithmic Justice League after her MIT Media Lab research documented disparate error rates in commercial facial analysis systems across skin tones.
Buolamwini founded the Algorithmic Justice League in 2016, following her MIT research showing commercial facial analysis systems performed significantly worse on darker-skinned faces, particularly women.
11. What does the EU AI Act, passed in March 2024, use as its primary regulatory mechanism?
Correct. The EU AI Act classifies systems into risk tiers β€” prohibited, high-risk, limited-risk, and minimal-risk β€” with obligations that scale with risk level.
The EU AI Act uses risk-based classification: prohibited uses (e.g., social scoring by governments), high-risk systems with strict obligations, and lighter requirements for lower-risk applications.
12. According to Indeed's Hiring Lab 2023 analysis of AI job postings, what percentage listed no degree requirement?
Correct. About 15% of AI job postings listed no degree requirement β€” a small but growing share, as demonstrated portfolio work increasingly substitutes for formal credentials in applied and adjacent roles.
15% of AI postings listed no degree requirement, with this category growing fastest. The majority (50%) required a bachelor's, and 35% required a graduate degree β€” concentrated in frontier research and senior ML engineering roles.
13. Which Canadian city became a major AI hub partly due to government funding for the Vector Institute in 2017?
Correct. Toronto's emergence as an AI hub is substantially linked to the Vector Institute for Artificial Intelligence, founded in 2017 with Canadian federal and provincial government support.
Toronto is the answer β€” the Vector Institute for AI, founded in 2017 with government backing, anchors Toronto's AI cluster alongside the University of Toronto (where Geoffrey Hinton held a long-term position).
14. What does "interpretability" mean in the context of AI safety research?
Correct. Interpretability research aims to make the internal mechanisms of neural networks understandable to human researchers β€” crucial for high-stakes deployments and safety verification.
Interpretability is about understanding a model's internals β€” why it produces a given output, what features it's responding to, how information flows through its layers. It's a technical safety research priority.
15. A 2023 Nature paper found that in how many of 50 reviewed AI ethics controversies had internal ethics teams raised concerns before the public controversy β€” and been overruled?
Correct. 38 of 50 cases β€” 76% β€” showed internal ethics teams raising concerns before the controversy became public, and being overruled. This finding underpins the structural debate about ethics authority placement.
In 38 of 50 cases reviewed, internal ethics teams had flagged concerns before the controversy β€” and been overruled. This empirical pattern is the basis for ongoing debate about where ethics authority should sit in AI organizations.