A Markovian Decision Process Analysis of Experienced Agents Joining Ad-Hoc Teams

2018 ◽  
Author(s):  
Roghaiyeh Heidari ◽  
Mohsen Afsharchi ◽  
Reza Khanmohammadi
Keyword(s):  
Decision Process ◽  
Ad Hoc ◽  
Process Analysis ◽  
Markovian Decision Process ◽  
Ad Hoc Teams

An Evacuation Decision Making Model for Firefighters in Ad Hoc Robot Network

2013 ◽  
Vol 756-759 ◽  
pp. 504-508
Author(s):  
De Min Li ◽  
Jian Zou ◽  
Kai Kai Yue ◽  
Hong Yun Guan ◽  
Jia Cun Wang
Keyword(s):  
Decision Making ◽  
Markov Decision Process ◽  
Decision Process ◽  
Ad Hoc ◽  
Decision Making Process ◽  
Decision Method ◽  
Markov Decision ◽  
Critical Problems ◽  
Fire Scene ◽  
Decision Making Model

Evacuation for a firefighter in complex fire scene is challenge problem. In this paper, we discuss a firefighters evacuation decision making model in ad hoc robot network on fire scene. Due to the dynamics on fire scene, we know that the sensed information in ad hoc robot network is also dynamically variance. So in this paper, we adapt dynamic decision method, Markov decision process, to model the firefighters decision making process for evacuation from fire scene. In firefighting decision making process, we know that the critical problems are how to define action space and evaluate the transition law in Markov decision process. In this paper, we discuss those problems according to the triangular sensors situation in ad hoc robot network and describe a decision making model for a firefighters evacuation the in the end.

scholarly journals Decision-Theoretic Planning with non-Markovian Rewards

2006 ◽  
Vol 25 ◽  
pp. 17-74 ◽  
Author(s):  
S. Thiebaux ◽  
C. Gretton ◽  
J. Slaney ◽  
D. Price ◽  
F. Kabanza
Keyword(s):  
Decision Process ◽  
Single Interface ◽  
Reward Function ◽  
Domain Specific ◽  
Current State ◽  
Markovian Decision Process ◽  
Solution Methods ◽  
Control Knowledge ◽  
Search Control ◽  
Domain Independent

A decision process in which rewards depend on history rather than merely on the current state is called a decision process with non-Markovian rewards (NMRDP). In decision-theoretic planning, where many desirable behaviours are more naturally expressed as properties of execution sequences rather than as properties of states, NMRDPs form a more natural model than the commonly adopted fully Markovian decision process (MDP) model. While the more tractable solution methods developed for MDPs do not directly apply in the presence of non-Markovian rewards, a number of solution methods for NMRDPs have been proposed in the literature. These all exploit a compact specification of the non-Markovian reward function in temporal logic, to automatically translate the NMRDP into an equivalent MDP which is solved using efficient MDP solution methods. This paper presents NMRDPP (Non-Markovian Reward Decision Process Planner), a software platform for the development and experimentation of methods for decision-theoretic planning with non-Markovian rewards. The current version of NMRDPP implements, under a single interface, a family of methods based on existing as well as new approaches which we describe in detail. These include dynamic programming, heuristic search, and structured methods. Using NMRDPP, we compare the methods and identify certain problem features that affect their performance. NMRDPP's treatment of non-Markovian rewards is inspired by the treatment of domain-specific search control knowledge in the TLPlan planner, which it incorporates as a special case. In the First International Probabilistic Planning Competition, NMRDPP was able to compete and perform well in both the domain-independent and hand-coded tracks, using search control knowledge in the latter.

Modified Markovian decision process model for limited data rate usage algorithm

2017 ◽  
Author(s):  
Rupam Deb ◽  
Prakash Chandra Mondal ◽  
Mohammad Mahfuzul Islam ◽  
Md. Jashim Uddin
Keyword(s):  
Decision Process ◽  
Process Model ◽  
Data Rate ◽  
Limited Data ◽  
Markovian Decision Process

Verbal Reports and Decision Process Analysis

2019 ◽  
pp. 270-285 ◽  
Author(s):  
Rob Ranyard ◽  
Ola Svenson
Keyword(s):  
Decision Process ◽  
Process Analysis ◽  
Verbal Reports

scholarly journals P073: Emergency department trauma team in situ simulations at an urban, academic centre to improve team communication and detect latent safety threats

CJEM ◽  
2020 ◽  
Vol 22 (S1) ◽  
pp. S90-S91
Author(s):  
N. Kester-Greene ◽  
L. Notario ◽  
H. Heipel ◽  
L. DaLuz ◽  
A. Nathens ◽  
...  
Keyword(s):  
Trauma Patient ◽  
Ad Hoc ◽  
Effective Means ◽  
Trauma Team ◽  
Trauma Patients ◽  
Team Communication ◽  
Interprofessional Communication ◽  
In Situ Simulation ◽  
Ad Hoc Teams

Innovation Concept: Effective communication for ad hoc teams is critical to successful management of multisystem trauma patients, to improve situational awareness and to mitigate risk of error. OBJECTIVES 1. Improve communication of ad hoc teams. 2. Identify system gaps. INNOVATION Team in situ simulations provide a unique opportunity to practice communication and assess systems in the real environment. Our trauma team consists of residents and staff from emergency services, general surgery, orthopedics, anaesthesia, nursing and respiratory therapy. Methods: A team of subject matter experts (SME's) from trauma, nursing, emergency medicine and simulation co-developed curriculum in response to a needs assessment that identified gaps in systems and team communication. The simulation occurred in the actual trauma bay. The on-call trauma team was paged and expected to manage a simulated multisystem trauma patient. Once the team arrived, they participated in a briefing, manikin-based simulation and a communication and system focused debriefing. Curriculum, Tool, or Material: Monthly scenarios consisted of management of a blunt trauma patient, emergency airway and massive hemorrhage protocol. Teams were assessed on communication skills and timeliness of interventions. Debriefing consisted of identification of system gaps and latent safety threats. Feedback was given by each discipline followed by SME's. Information was gathered from participant evaluations (5-point Likert scale and open ended questions) and group debrief. Feedback was themed and actions taken to co-create interventions to communication gaps and latent safety threats. As a result, cricothyroidotomy trays were standardized throughout the hospital to mitigate confusion, time delay and unfamiliarity during difficult airway interventions. Participants felt the exercise was an effective means of practicing interprofessional communication and role clarity, and improved their attitude towards the same. Conclusion: In situ simulation-based education with ad hoc trauma teams can improve interprofessional communication and identify latent safety threats for the management of multisystem trauma patients.

Who Am I as a Healthcare Provider?

2020 ◽  
pp. 1028-1043
Author(s):  
Rachel Umoren ◽  
Natalia Rybas
Keyword(s):  
Professional Education ◽  
Interprofessional Education ◽  
Ad Hoc ◽  
Healthcare Delivery ◽  
Healthcare Delivery System ◽  
Team Members ◽  
Professional Students ◽  
Interprofessional Teams ◽  
Acute Patient ◽  
Ad Hoc Teams

The U.S. healthcare delivery system relies on the formation of ad hoc teams of highly-trained, experienced, providers of various specialties. The providers work in interprofessional teams that converge to address situations around acute patient care. Various models of virtual training provide structured opportunities for interprofessional education, whereby learners engage with roles and responsibilities essential for their professions and active collaboration with other team members. This learning is transformative as it influences the development of professional identity and teamwork skills needed for successful collaborative practice in interprofessional teams. This chapter explores the role of training health care professional students using virtual simulations and the emerging potential of virtual and augmented reality for health professional education.

First Impressions, Team Satisfaction and Work-Related Flow: A Multilevel Analysis

2018 ◽  
Vol 62 (1) ◽  
pp. 782-786
Author(s):  
Sarah Berger ◽  
Jeffery Hanrahan ◽  
Andrea Bizarro ◽  
Robert Henning
Keyword(s):  
Hierarchical Linear Modeling ◽  
Ad Hoc ◽  
First Impressions ◽  
Linear Modeling ◽  
Team Members ◽  
Work Related ◽  
Team Satisfaction ◽  
The Individual ◽  
Ad Hoc Teams ◽  
Flow Experiences

First impressions of fellow team members, as well as individual satisfaction with one’s team, are each related to work-related flow experiences but they are rarely studied in combination. To address this gap we collected measures of all three in a laboratory study of dyadic teams (N=55). First impressions were assessed prior to the start of a management simulation task, and both team satisfaction and work-related flow were assessed afterwards. Hierarchical linear modeling revealed that measures of team satisfaction at both the individual and team levels were predictive of work-related flow experiences; an interaction between the discrepancy in first impression ratings within each team and individual ratings of team satisfaction was also found. Findings suggest that discrepancies in first impressions interact with team satisfaction in ways that may negatively impact work-related flow experiences, which in turn has the potential to impair team formation and performance effectiveness of ad hoc teams.

AD-HOC TEAMS

2006 ◽  
pp. 24-24
Keyword(s):  
Ad Hoc ◽  
Ad Hoc Teams

Semi-autonomous management of multiple ad-hoc teams of UAVs

2015 ◽  
Author(s):  
Richard Loe ◽  
Christopher Maracchion ◽  
Andrew Drozd
Keyword(s):  
Ad Hoc ◽  
Autonomous Management ◽  
Ad Hoc Teams

Fuzzy Markovian decision process

1998 ◽  
Vol 99 (3) ◽  
pp. 273-282 ◽  
Author(s):  
Malay Bhattacharyya
Keyword(s):  
Decision Process ◽  
Markovian Decision Process
Sign in / Sign up

Export Citation Format

Share Document