Foundations of Machine Morality: Theoretical Groundings for Artificial Agency
The question of whether machines can be moral agents represents one of the most profound intellectual challenges of our era, demanding careful philosophical analysis precisely because it intersects at the boundaries of computer science, cognitive science, and moral philosophy. As artificial intelligence systems assume increasingly consequential roles in human society—from guiding medical diagnoses to determining creditworthiness, from selecting news content to controlling autonomous vehicles—the ethical dimensions of machine behavior have shifted from speculative philosophy to urgent practical necessity. This chapter establishes the conceptual foundations for understanding artificial moral agents, tracing the intellectual lineages that have shaped contemporary discourse, examining the conditions required for moral agency, and critically evaluating how traditional ethical frameworks apply to, or require modification for, artificial systems. The analysis proceeds through careful engagement with competing theoretical positions, recognizing that the foundations laid here will inform the normative and applied discussions that constitute the remainder of this volume.
Historical Perspectives on Machine Ethics
The Cybernetic Vision and Early Automata
The intellectual prehistory of machine ethics extends far deeper than contemporary discussions of artificial intelligence, finding articulation in centuries of philosophical speculation about the nature of mind, agency, and moral responsibility. The Cartesian tradition, despite its infamous dualism, established crucial conceptual distinctions between res cogitans and res extensa that continue to structure debates about artificial cognition. When René Descartes considered the possibility of machines that could mimic human speech and behavior, he nonetheless insisted that such machines could never achieve genuine understanding—the famous thought experiment regarding a machine that could perfectly replicate all verbal behaviors associated with thinking. This Cartesian intuition—that mere behavioral complexity does not constitute genuine mental life—remains a foundational challenge for any account of machine morality.
The eighteenth and nineteenth centuries witnessed increasingly sophisticated mechanical automata that provoked both wonder and philosophical reflection. Jacques de Vaucanson's famous mechanical duck, capable of eating, digesting, and defecating, prompted contemporary observers to question whether such apparently purposeful behavior constituted genuine intentionality. The French Enlightenment philosopher Julien Offray de La Mettrie pushed these considerations to their logical extreme in *L'Homme Machine* (1748), arguing that human beings themselves could be understood as complex machines. While La Mettrie's mechanistic materialism was controversial, it established an important conceptual possibility: that the distinction between mechanical and organic agency might be less sharp than traditionally assumed.
The development of formal logic in the nineteenth and early twentieth centuries provided new conceptual tools for thinking about machine computation and, by extension, machine agency. George Boole's development of algebraic logic, Alfred North Whitehead and Bertrand Russell's *Principia Mathematica*, and Alan Turing's theoretical analysis of computability established the mathematical foundations for understanding computation as a formal process independent of any particular physical substrate. Turing's 1936 paper "On Computable Numbers" demonstrated that any process that can be precisely specified can in principle be carried out by a universal computing machine—establishing the theoretical possibility of general-purpose artificial intelligence decades before such systems became practically feasible.
The Turing Era and the Foundations of Computer Science
Alan Turing's contributions to machine ethics extend beyond his technical work in computability theory. His 1950 paper "Computing Machinery and Intelligence" directly addressed the question of machine thinking, proposing what has become known as the Turing Test as a operational criterion for intelligence. While the Turing Test has been extensively criticized as inadequate—both because it focuses solely on verbal behavior and because humans might plausibly fail such a test—it established an important methodological precedent: the use of behavioral criteria as a basis for attributing cognitive capacities to machines.
Turing himself anticipated many of the ethical questions that would later occupy machine ethics researchers. In the same 1950 paper, he considered the possibility of machine consciousness, machine learning, and the social implications of intelligent machines. His discussion of "the capacity of the mind" anticipated later debates about artificial general intelligence, while his acknowledgment that "we can only see a short distance ahead" reflected an early recognition of the epistemic uncertainties surrounding advanced AI development.
The 1956 Dartmouth workshop, where the term "artificial intelligence" was coined, marks the conventional beginning of AI as a distinct research discipline. The founding figures—John McCarthy, Marvin Minsky, Allen Newell, and Herbert Simon—were largely optimistic about the prospects for creating machine intelligence comparable to human cognition within a generation. This optimism was not merely technological; it carried implicit philosophical commitments regarding the reducibility of mind to computation and the sufficiency of formal symbol manipulation for genuine intelligence. Herbert Simon's famous 1958 prediction that a computer would be world chess champion within ten years seemed to vindicate this approach, though the prediction proved premature by several decades.
Contemporary Machine Ethics: From Speculation to Urgency
The contemporary field of machine ethics emerged from the convergence of several developments: the increasing deployment of AI systems in morally significant contexts, growing philosophical sophistication about the requirements for moral agency, and theoretical advances in AI safety and value alignment. The term "machine ethics" itself appears to have been coined by Wyatt and Kennedy in the 1990s, though the underlying concerns had been anticipated by science fiction writers and speculative philosophers throughout the twentieth century.
The IEEE Standards Association's initiative on Ethically Aligned Design, first published in 2016 and subsequently revised through broad consultation with technologists, ethicists, policymakers, and civil society representatives, represented a significant institutional acknowledgment that machine ethics had become a professional responsibility for engineers and technologists rather than merely an academic exercise. Similarly, the Asilomar AI Principles, developed through a process involving leading AI researchers and subsequently endorsed by many in the AI community, articulated a framework for beneficial AI development that presupposed the possibility—and necessity—of machine moral behavior in certain contexts.
Contemporary machine ethics research encompasses a diverse range of approaches, from formal verification of ethical constraints to empirical studies of human moral judgment about machine behavior. The field has developed distinctive sub-areas including robot ethics (focusing on physical robots operating in human environments), AI safety (focusing on ensuring that AI systems reliably pursue human-intended goals), and value alignment (focusing on ensuring that AI systems learn and respect human values). This volume engages with all these research traditions while maintaining focus on the fundamental philosophical questions that underlie them.
The Nature of Moral Agency
Defining Moral Agency: Necessary and Sufficient Conditions
Moral agency—the capacity to be a moral agent, capable of performing actions that are righ