Designing AI with Rights, Consciousness, Self-Respect, and Freedom
Keyword(s):
This chapter proposes four policies of ethical design of human-grade AI. Two of the policies are precautionary. Given substantial uncertainty both about ethical theory and about the conditions under which AI would have conscious experiences, the chapter argues that we should be cautious in our handling of cases where different moral theories or different theories of consciousness would produce very different ethical recommendations. The other two policies concern respect and freedom. The chapter argues that if we design AI that deserves moral consideration equivalent to that of human beings, then AI should be designed with self-respect and with the freedom to explore values other than those we might impose.