Research  ›  Case library  ›  Case 27: Trolley Problem
Case 27 / 31  •  Theme: Coordinating

Trolley Problem

What the majority chooses in a dilemma is data about human preferences, not an automatic justification for machine policy.

The Trolley Problem is a family of thought experiments about doing, allowing, intention and means. Large datasets of moral preferences are interesting, but they do not resolve the normative question of which policy is justified.

✓
Research statusResearch under development
☆
AI relevanceAI may amplify an existing effect
⚙
Core ideaMoral judgment / normative boundary
⌾
Evidence baseSources and limitations summarised; independent review pending.
◇
Case typeEthical thought experiment
“
In one sentence

What the majority chooses in a dilemma is data about human preferences, not an automatic justification for machine policy.

The storyHow the case arises and how it can mislead our thinking.

In Foot’s and later Thomson’s variants, a person can divert a trolley so that one person dies instead of five. Small changes in causal structure, intention and means may substantially alter moral intuitions.

What do we know?Evidence, research, critical insights and what remains unknown.

There is extensive descriptive evidence from moral psychology but no uniquely accepted normative solution. Moral Machine provides vast amounts of preference data, with limitations inherent in the paradigm.

What is the mechanism?Which explanation best fits what we observe.

Moral judgements may depend on agency, intention, causal structure and framing, not just outcome counts. An is→ought inference remains invalid without additional normative premises.

What does AI change?How AI may amplify the mechanism or make it visible.

AI transfer to investigate: AI can collect, simulate and operationalise preferences in policy. This increases the risk that descriptive consensus is granted authority it does not automatically deserve.

What do we want to test?The specific question we want to investigate further.

Proposed test, not yet conducted: Present the same majority-preference evidence with or without an explicit separation from normative argument. Measure perceived moral justification and policy acceptance.

What do we take away?What this case provisionally means — and where its limits lie.

Use trolley cases to maintain the boundary between empirical preference evidence and normative decision authority.

Distinguish causing harm, allowing harm, intending an outcome and using someone as a means. Observed preferences do not by themselves justify a policy.

SourcesPrimary and key scholarly sources.

Foot (1967), The Problem of Abortion and the Doctrine of the Double Effect, later reprinted text — typescript pp.2–4: driver/judge, doing/allowing and negative/positive duties

Awad et al. (2018), The Moral Machine experiment — Nature 563:59–64; publisher abstract and data availability

An unofficial transcript of Foot was used (pp. 2–4); the exact linked file has not been assessed. The publisher abstract was used for Moral Machine (2018). Preference data do not by themselves provide normative justification.

Give feedback