The Decision-Making Engine

Author(s):  
Thomas Boraud

This chapter presents an upgrade of the neural network by implementing the reward prediction error. It then compares the final product with the actor-critic model and discusses the similarities and differences. Reinforcement learning algorithms, more specifically actor-critic models, are currently very successful in the field of decision-making. They are notably related to properties of dopaminergic neurons which have not yet been addressed in previous chapters. It has been demonstrated that dopaminergic neurons respond when the subject receives a reward or when the subject associates a conditional stimulus with the reward, and that this response to the stimulus is proportional to the utility function of the reward. In fact, dopaminergic neurons behave exactly like a process that computes temporal difference. The amplitude of their response when the reward is administered is proportional to the difference between the expected utility at time and the reward actually obtained at the moment, i.e. the temporal difference. This chapter then assesses whether the telencephalic loop is an actor-critic system.

Author(s):  
Janet Levin

In contemporary discussions in the philosophy of mind, the terms quale and qualia (plural) are most commonly used to denote features of our conscious mental states such as the throbbing pain of my headache, the warmth I feel when I hold my hands over the fire, or the greenish character of my visual experience when I look at the tree outside my window (or stare hard at something red and then close my eyes). To use the now-standard locution introduced by Thomas Nagel, a subject’s mental state has qualia (or, equivalently, phenomenal properties) just in case there is something it is like for the subject to be in that state, and there are phenomenal similarities and differences among a subject’s mental states (that is, similarities and differences in their qualia) just in case there are similarities and differences in what it is like for that subject to be in those states. Qualia, in this sense, can be more or less specific: the state I am in at the moment can be an example of a migraine, a headache, a pain and, even more generally, a bodily sensation. And a mental state can have a distinctive phenomenal property, or quale, even if its subject cannot pick it out in terms any more descriptive than ‘I’m now feeling something funny’, or ‘I’ve never had an experience quite like this’. Sometimes the terms ‘quale’ and ‘qualia’ have been used more restrictively, to denote properties of mental states that are irreducibly nonphysical. ‘Qualia’ has also been used to denote ‘sense-data’, that is, image-like elements of perceptual experiences whose properties are directly and infallibly accessible to the subject of those experiences (and thus provide ‘data’ for our theories of the world). Indeed, C. I. Lewis, who is generally thought to have introduced the term, used ‘qualia’ in this way, and many others (e.g. Dennett 1988: 229) have understood ‘qualia’ to denote properties that are ‘ineffable, intrinsic, private, and directly or immediately apprehensible in consciousness’. Thus philosophical disputes about qualia have often taken the form of disputes about whether qualia exist, rather than about what sorts of properties qualia could be. But most philosophers now use these terms more neutrally, as characterized above - and attempt to argue that qualia must have (or can lack) these further metaphysical and epistemological characteristics. Perhaps the most contentious dispute about qualia is whether they can have a place in the physical world; whether, that is, they could be identical with physical, functional or otherwise natural properties, or must rather be regarded as irreducibly nonphysical features of our mental states. There are also significant epistemological questions about qualia - in particular, how we come to have knowledge of the phenomenal properties of our own mental states, whether our beliefs about these properties can be taken to be infallible, or at least to have some kind of special authority not possessed by our beliefs about the world outside our minds, and whether, and if so, how, we could have such knowledge of the mental states of others. In addition, it has traditionally been routine to distinguish ‘qualitative’ states such as sensations and perceptual experiences from purely representational (or intentional) states such as beliefs, thoughts and preferences, but this distinction is now under challenge. Thus another important question about qualia is how extensive they are in our mental lives: whether they are possessed by all our conscious mental states, including thoughts, beliefs, intentions and preferences, or merely some, such as sensations and perceptions.


Author(s):  
Thomas Boraud

This chapter explores the flexibility of the neural network described in the previous chapters. It also shows that the anterior part of the brain can be subdivided into five functional loops that underlie different executive functions. These five major loops are the motor loop, the oculomotor loop, the prefrontal loop, the orbitofrontal loop, and the cingular loop. The first two circuits deal with the learning and decision-making processes of the motor domain. The prefrontal and frontal circuits are involved in cognitive processes. Finally, the cingular circuit is involved in episodic memory, regulation of emotions, and modulation of mood. Therefore, one can already see a certain hierarchical order, underpinned by anatomical realities: the mood, emotions, and personal history of the subject (the memory) will condition the cognitive functions that will influence motor behaviours. This hierarchy can be concretized by direct interactions between the different loops, of which anatomical evidence has been demonstrated several times.


2020 ◽  
Vol 32 (4) ◽  
pp. 114-125
Author(s):  
Ádám Nyerges

The subject of the present study is an examination of the activities of two governments with a two-thirds parliamentary majority. For the past 10 years, it has been these governments with two closed cycles of government that have had the authority to structurally transform the Hungarian political system without the involvement of the opposition. The study will also present the measures taken over the first hundred days, as well as, to a lesser extent, the political environment of each government and the predestined goals. The summary also highlights some similarities and differences in the speed and quality of government work and its decision-making, which requires a qualified majority.


Author(s):  
Nicolas de Warren

This chapter explores the meaning and importance of the question “What is time?” in the phenomenological philosophies of Husserl, Heidegger, and Levinas. As developed in this chapter, the question of time is for each of these thinkers inseparable from the question of subjectivity. To pose the question “What is time?” is equally to pose the question “Who is the subject in time?” In addition to a discussion of the relation between time and subjectivity, this chapter further examines how for each of these thinkers their respective understanding of time is configured around a twofold sense of temporal difference: the difference between past, present, and future within time; and the difference between time and eternity.


2020 ◽  
Vol 83 ◽  
pp. 01009
Author(s):  
Nina Dědečková

The aim of the paper is to define and compare definitions and objectives of the managerial control and controlling based on research of scientific and professional literature through the opinions of domestic and foreign authors. By studying several domestic and foreign sources, through analogy, analysis, synthesis and comparison, we were able to create an overview of the research areas and defined the basic areas of managerial function of control and controlling. Our finding is that managerial control and controlling is still an actual topic. It is the subject of research by many theorists who focus on defining of these terms. Control is often perceived only as a comparison of two states, ie as the difference between the plan and the reality, while controlling in addition to comparisons also understands controlling as the implementation of corrective actions, thus supporting planning and decision-making. In this paper we identify the opinions of various authors and emphasize the importance of these terms.


Author(s):  
Iku Tsutsui-Kimura ◽  
Hideyuki Matsumoto ◽  
Naoshige Uchida ◽  
Mitsuko Watabe-Uchida

SUMMARYDifferent regions of the striatum regulate different types of behavior. However, how dopamine signals differ across striatal regions and how dopamine regulates different behaviors remain unclear. Here, we compared dopamine axon activity in the ventral, dorsomedial, and dorsolateral striatum, while mice performed in a perceptual and value-based decision task. Surprisingly, dopamine axon activity was similar across all three areas. At a glance, the activity multiplexed different variables such as stimulus-associated values, confidence and reward feedback at different phases of the task. Our modeling demonstrates, however, that these modulations can be inclusively explained by moment-by-moment changes in the expected reward, i.e. the temporal difference error. A major difference between these areas was the overall activity level of reward responses: reward responses in dorsolateral striatum (DLS) were positively shifted, lacking inhibitory responses to negative prediction error. Tenets of habit and skill can be explained by this positively biased dopamine signal in DLS.


Author(s):  
Milton César García Castiblanco

ABSTRACTThis report is part of the experience as a teacher for five years, the subject of simulation programs Systems Engineering. The simulation is to build computer models that describe the essential part of the behavior of a system of interest. As well as designing and conducting experiments with such models in order to draw conclusions from their results to support decision-making. A typical question of students to the knowledge received from many of the issues during his career is: What is the actual use can give this issue? In the case of simulation this situation is more complex because the basics needed to make the most of this course are acquired in the first semester, in different subjects and not generally work transversely. In my experience I have found that the best way with which the student can understand the use that can give you the knowledge acquired is to face real situations, not just cases of typical study such as business, but situations that happen in your environment real, at the moment of learning. This document will not only reference to based on realities but also to the real problems which have achieved together with my students apply the knowledge acquired learning.RESUMENEste informe hace parte de las experiencias como docente durante cinco años, de la asignatura de simulación en programas de Ingeniería de Sistemas. La simulación consiste en construir modelos informáticos que describen la parte esencial del comportamiento de un sistema de interés. Así como en diseñar y realizar experimentos con tales modelos con el fin de extraer conclusiones de sus resultados para apoyar la toma de decisiones. Una pregunta típica de los estudiantes ante el conocimiento recibido de los temas durante su carrera es: ¿Cuál es el uso real que puedo darle? Para la simulación esta situación es más compleja dado que los conceptos básicos necesarios para esta asignatura son adquiridos en los primeros semestres, en asignaturas diferentes y que no se trabajan transversalmente. En mi experiencia he encontrado que la mejor forma para que el estudiante entienda el uso que le puede dar a su conocimiento, es enfrentarse a situaciones reales, no solo a casos de estudio típico, sino a situaciones que suceden en su entorno real, en el momento actual de su aprendizaje. Este documento no solo hará referencia al aprendizaje basado en realidades sino también a los problemas reales trabajados con mis estudiantes aplicando el conocimiento adquirido. Contacto principal: [email protected]


2020 ◽  
Vol 3 (2) ◽  
pp. 71
Author(s):  
Iva Hanani ◽  
Suray Agung Nugroho

The aim of this study is to explain Korean and Javanese subject honorific and identify its similarities and differences. To accomplish it, this research was conducted using literature review method. Data related to the Javanese language were taken from two Javanese drama scripts, namely Mak Ana Asu Mlebu Ngomah and Bantul Sangsaya Pinunjul, and Javanese drama titled Sri Ngilang by George Quinn. Korean language data was taken from television drama, Misaeng and Fight for My Way. Based on the analysis that has been carried out, despite the difference of the honorific system of Korean dan Javanese, Javanese has subject honorific as described in the Korean honorific system. Both languages use words that have honorific meaning to honor the subject and use words that are usually used for the animal to dishonor the subject of the sentence. The difference between both languages on subject honorific is Korean subject honorific is mainly realized grammatically, whereas in Javanese is realized lexically. In addition, there are rules from the Korean government regarding the use of one type of subject honorific, abjonbeob, whereas in Javanese there are no rules related to the use of speech level.


10.5219/1018 ◽  
2019 ◽  
Vol 13 (1) ◽  
pp. 38-45 ◽  
Author(s):  
Jana Němcová ◽  
Jakub Berčík

In recent years, interest in scholarly research on buying behaviour of Generation Y has grown. However, studies are mainly realized abroad and many of them deal with this issue in general. The purpose of this paper is to identify the factors influencing the decision-making process of the Generation Y customers in the selection of wine in the Slovak Republic. A total of 21 respondents participated in the survey. Eye-tracking and a questionnaire were selected for research. For processing and evaluating the eye-tracking research, the Gazepoint Analysis UX Edition software and Microsoft Excel were used. For statistical data analysis, the Kruskal-Wallis test and Spearman's non-parametric test were performed. Based on the results of the questionnaire and the testing, a label was the most important factor. Differences were noted at the moment of examining the information on a label. The most important factor determined by the questionnaire survey was variety, or vintage year, but by using measurement, the most important factor was label design. With regard to bottle shape, the most preferred was the Bordeaux type of bottle. Testing was carried out in laboratory conditions that only simulated the real selection of wine. This could have caused the difference between conscious decision-making and unconscious visual attention. Therefore, in the future, it is recommended to carry out similar research using a mobile eye camera to realize the test with real wine bottles. It is also assumed to involve other methods to obtain information about real attention of the tested probands. The presented research provides information for winegrowers and merchants who can improve their products and communicate effectively with customers. Findings are particularly beneficial because this research is among the first carried out in this area and it was not based only on conscious participation of respondents, but also on unconscious perception, because a deeper understanding of unconscious influences, that shape consumer's decision, helps to better understand consumer's behaviour.


Manuskripta ◽  
2020 ◽  
Vol 10 (1) ◽  
pp. 67
Author(s):  
Novarina Novarina

Abstract: This research is a comparative literary study that uses Malay and Javanese versions of Mahabarata text sources. The research objects used were the text edition of Pandhawa Gubah (PG) by Sudibjo Z. Hadisutjipto and the text of Cheritera Pandawa Lima (CPL) by Khalid Hussain. The research method used is descriptive-analysis method. In the comparative study used a comparative literary theory proposed by Endraswara (2011). The results of the text comparison reveal the similarities and differences in the image of Bima figures in the Javanese and Malay versions. The equation as a whole is that both texts contain the same heroic storyline and heroic character, Bima. In addition, Indian influence is still evident in the two texts seen from the nuances of Hinduism that exist in both texts. While the difference is seen in the events that accompany Bima's struggle in achieving his victory. Based on these similarities and differences, it can be seen that the authors attempt to represent the concept of metaphysical interactions vertically and horizontally expressed through PG text. --- Abstrak: Penelitian ini adalah satu kajian sastra bandingan yang menggunakan sumber teks Mahabarata versi Melayu dan Jawa. Objek penelitian yang digunakan adalah edisi teks Pandhawa Gubah (PG) karya Sudibjo Z. Hadisutjipto dan teks Cheritera Pandawa Lima (CPL) karya Khalid Hussain. Metode penelitian yang digunakan adalah metode deskriptif-analisis. Dalam telaah perbandingan digunakan teori sastra bandingan yang dikemukakan Endraswara (2011). Hasil perbandingan teks mengungkapkan adanya persamaan dan perbedaan citra tokoh Bima dalam versi Jawa maupun versi Melayu. Persamaan secara keseluruhan adalah kedua teks tersebut mengandung alur cerita kepahlawanan dan tokoh pahlawan yang sama yaitu Bima. Selain itu, pengaruh India masih tampak dalam kedua teks tersebut dilihat dari nuansa Hinduisme yang ada dalam kedua teks. Sementara perbedaannya tampak pada peristiwa-peristiwa yang menyertai perjuangan Bima dalam mencapai kemenangannya. Berdasarkan persamaan dan perbedaan tersebut tampak adanya upaya penulis untuk merepresentasikan konsep interaksi metafisik secara vertikal dan horizontal yang diungkapkan melalui teks PG.


Sign in / Sign up

Export Citation Format

Share Document