Moral Machines

Author(s):  
Wendell Wallach ◽  
Shannon Vallor

Implementing sensitivity to norms, laws, and human values in computational systems has transitioned from philosophical reflection to an actual engineering challenge. The “value alignment” approach to dealing with superintelligent AIs tends to employ computationally friendly concepts such as utility functions, system goals, agent preferences, and value optimizers, which, this chapter argues, do not have intrinsic ethical significance. This chapter considers what may be lost in the excision of intrinsically ethical concepts from the project of engineering moral machines. It argues that human-level AI and superintelligent systems can be assured to be safe and beneficial only if they embody something like virtue or moral character and that virtue embodiment is a more appropriate long-term goal for AI safety research than value alignment.

Philosophies ◽  
2021 ◽  
Vol 6 (1) ◽  
pp. 6
Author(s):  
Nadisha-Marie Aliman ◽  
Leon Kester ◽  
Roman Yampolskiy

In the last years, artificial intelligence (AI) safety gained international recognition in the light of heterogeneous safety-critical and ethical issues that risk overshadowing the broad beneficial impacts of AI. In this context, the implementation of AI observatory endeavors represents one key research direction. This paper motivates the need for an inherently transdisciplinary AI observatory approach integrating diverse retrospective and counterfactual views. We delineate aims and limitations while providing hands-on-advice utilizing concrete practical examples. Distinguishing between unintentionally and intentionally triggered AI risks with diverse socio-psycho-technological impacts, we exemplify a retrospective descriptive analysis followed by a retrospective counterfactual risk analysis. Building on these AI observatory tools, we present near-term transdisciplinary guidelines for AI safety. As further contribution, we discuss differentiated and tailored long-term directions through the lens of two disparate modern AI safety paradigms. For simplicity, we refer to these two different paradigms with the terms artificial stupidity (AS) and eternal creativity (EC) respectively. While both AS and EC acknowledge the need for a hybrid cognitive-affective approach to AI safety and overlap with regard to many short-term considerations, they differ fundamentally in the nature of multiple envisaged long-term solution patterns. By compiling relevant underlying contradistinctions, we aim to provide future-oriented incentives for constructive dialectics in practical and theoretical AI safety research.


2017 ◽  
Author(s):  
Gopal P. Sarma ◽  
Nick J. Hay ◽  
Adam Safron

We propose the creation of a systematic effort to identify and replicate key findings in neuroscience and allied fields related to understanding human values. Our aim is to ensure that research underpinning the value alignment problem of artificial intelligence has been sufficiently validated to play a role in the design of AI systems.


2017 ◽  
Vol 187 ◽  
pp. 156-169 ◽  
Author(s):  
Jonathan P. Piccini ◽  
Richard L. Clark ◽  
Peter R. Kowey ◽  
Suneet Mittal ◽  
Preston Dunnmon ◽  
...  

2019 ◽  
Author(s):  
Maureen A. Carey ◽  
Andreas Dräger ◽  
Jason A. Papin ◽  
James T. Yurkovich

ABSTRACTStandardization of data and models facilitates effective communication, especially in computational systems biology. However, both the development and consistent use of standards and resources remains challenging. As a result, the amount, quality, and format of the information contained within systems biology models are not consistent and therefore present challenges for widespread use and communication. Here, we focused on these standards, resources, and challenges in the field of metabolic modeling by conducting a community-wide survey. We used this feedback to (1) outline the major challenges that our field faces and to propose solutions and (2) identify a set of features that defines what a “gold standard” metabolic network reconstruction looks like concerning content, annotation, and simulation capabilities. We anticipate that this community-driven outline will help the long-term development of community-inspired resources as well as produce high-quality, accessible models. More broadly, we hope that these efforts can serve as blueprints for other computational modeling communities to ensure continued development of both practical, usable standards and reproducible, knowledge-rich models.


alashriyyah ◽  
2019 ◽  
Vol 5 (1) ◽  
pp. 16
Author(s):  
Mohamad Samsudin

Indonesian development runs on the foundation of Indonesia's long-term vision, namely the realization of nation-states, modern Indonesia that is safe and peaceful, fair and democratic, and prosperous by upholding human values, independence and unity based on Pancasila and The 1945 Constitution. To realize this, education as a subsystem is one of the important aspects to be considered in its direction and purpose so that education is not merely an aspect of supporting Indonesia's development, but as a locomotive of development itself. Because in reality, education is one aspect of life that is run by being influenced by various external aspects that are interrelated with each other such as political, economic, socio-cultural, defense-security aspects, even ideology has a very strong influence on the continuity of education, and vice versa. This paper aims to find out how the Long Term Development Plan (RPJP) is specifically regarding national education between 2005-2010 and 2010-2025. To achieve this goal, the author uses content analysis research using written documents that have been used as guidelines to determine the direction of the Indonesian government's policy in realizing national development. The results of the research in this paper show that the development of national education in the future is based on the paradigm of developing Indonesian people as a whole. The humanitarian dimension includes the three most basic things, namely: cognitive, affective, and psychomotor. This is based on the desire to realize the education system as a strong and authoritative social institution to empower all citizens of Indonesia to develop into quality human beings so that they are able and proactively respond to the challenges of an ever-changing era.


2018 ◽  
Author(s):  
Lily Morse ◽  
Taya R. Cohen

In this article, we discuss the role of moral character in negotiation and identify open questions and promising directions for future scholars to explore. We advance research in this area by introducing a dyadic model of moral character in negotiation, which highlights the joint influence of each party’s moral character on negotiation attitudes, motives, and behaviors. We discuss the implications of our model and conclude that personality science, and especially the study of moral character, has great potential to enhance research and practice in negotiations. Our hope is that this work will accelerate theoretical development and empirical studies that address the question of how moral character influences negotiation processes and outcomes—from pre-negotiation (e.g., planning, selecting negotiating partners) to actual bargaining (e.g., bargaining tactics, concessions) and finally, post-negotiation (e.g., deal implementation, long-term consequences, relationship building and maintenance, reputations)—and provide a springboard for future studies on this topic.


2010 ◽  
Vol 22 (7) ◽  
pp. 1899-1926 ◽  
Author(s):  
Huajin Tang ◽  
Haizhou Li ◽  
Rui Yan

Memory is a fundamental part of computational systems like the human brain. Theoretical models identify memories as attractors of neural network activity patterns based on the theory that attractor (recurrent) neural networks are able to capture some crucial characteristics of memory, such as encoding, storage, retrieval, and long-term and working memory. In such networks, long-term storage of the memory patterns is enabled by synaptic strengths that are adjusted according to some activity-dependent plasticity mechanisms (of which the most widely recognized is the Hebbian rule) such that the attractors of the network dynamics represent the stored memories. Most of previous studies on associative memory are focused on Hopfield-like binary networks, and the learned patterns are often assumed to be uncorrelated in a way that minimal interactions between memories are facilitated. In this letter, we restrict our attention to a more biological plausible attractor network model and study the neuronal representations of correlated patterns. We have examined the role of saliency weights in memory dynamics. Our results demonstrate that the retrieval process of the memorized patterns is characterized by the saliency distribution, which affects the landscape of the attractors. We have established the conditions that the network state converges to unique memory and multiple memories. The analytical result also holds for other cases for variable coding levels and nonbinary levels, indicating a general property emerging from correlated memories. Our results confirmed the advantage of computing with graded-response neurons over binary neurons (i.e., reducing of spurious states). It was also found that the nonuniform saliency distribution can contribute to disappearance of spurious states when they exit.


2021 ◽  
pp. 35-69
Author(s):  
Neil Richards

Target Corporation’s famous use of big data to predict which of its customers were pregnant involved a potent cocktail of behavioral science and data science to influence customers’ behavior without their knowledge. In Target’s case, it sent coupons to pregnant women so as to habituate them into becoming long-term Target customers. Its real lesson is that human information confers the power to control human behavior. Rather than thinking principally about defining privacy, we should think about regulating to protect people from the power that human information confers. This conclusion has four important implications. First, it reveals that privacy is fundamentally about power—power over human beings in society. Second, struggles over “privacy” are really struggles over the rules that constrain the power that human information confers. Third, privacy rules of some sort are inevitable. Fourth, privacy should be thought of in instrumental terms to promote human values.


Sign in / Sign up

Export Citation Format

Share Document