Discretetimemarkovdecisionprocesses: Average Criterion

2007 ◽  
pp. 39-61
Keyword(s):  
Average Criterion

scholarly journals Denumerable state continuous time Markov decision processes with unbounded cost and transition rates under average criterion

2002 ◽  
Vol 43 (4) ◽  
pp. 541-557 ◽  
Author(s):  
Xianping Guo ◽  
Weiping Zhu
Keyword(s):  
Markov Decision Processes ◽  
Continuous Time ◽  
Decision Processes ◽  
Transition Rates ◽  
Birth And Death Processes ◽  
Optimality Equation ◽  
Average Criterion ◽  
Markov Decision ◽  
Unbounded Cost ◽  
Queue Model

AbstractIn this paper, we consider denumerable state continuous time Markov decision processes with (possibly unbounded) transition and cost rates under average criterion. We present a set of conditions and prove the existence of both average cost optimal stationary policies and a solution of the average optimality equation under the conditions. The results in this paper are applied to an admission control queue model and controlled birth and death processes.

Rutting Development in Linear Tracking Test Pavements To Evaluate Shell Subgrade Strain Criterion

1997 ◽  
Vol 1570 (1) ◽  
pp. 23-29 ◽  
Author(s):  
J. Groenendijk ◽  
C. H. Vogelzang ◽  
A. Miradi ◽  
A. A. A. Molenaar ◽  
L. J. M. Dohmen
Keyword(s):  
Data Analysis ◽  
Shear Deformation ◽  
Asphalt Concrete ◽  
Heavy Traffic ◽  
Falling Weight Deflectometer ◽  
Wheel Load ◽  
Strain Criterion ◽  
Average Criterion ◽  
Tracking Device ◽  
Falling Weight

Two full-depth gravel asphalt concrete (AC) pavements of 0.15- and 0.08-m thickness on a sand subgrade were loaded with 4 million and 0.65 million repetitions of a 75-kN super-single wheel load using the linear tracking device (LINTRACK), a heavy-traffic simulator. Frequent measurements of asphalt strains, temperatures, rutting, cracking, and falling weight deflectometer (FWD) were made. The data analysis of the rutting measurements indicates that all rutting could be ascribed to subgrade deformation (secondary rutting). No evidence was found of shear deformation within the asphalt layer (primary rutting). The data analysis also indicates that the observed rutting performance of the LINTRACK test sections (to a maximum rut depth of 18 mm) coincides closely with the average criterion from the Shell Pavement Design Manual, which relates subgrade strain to allowable number of strain repetitions.

A Fluid EOQ Model with Markovian Environment

2015 ◽  
Vol 52 (02) ◽  
pp. 473-489
Author(s):  
Yonit Barron
Keyword(s):  
Continuous Time ◽  
Inventory Level ◽  
Continuous Time Markov Chain ◽  
Holding Costs ◽  
Eoq Model ◽  
Long Run ◽  
Average Criterion ◽  
Production Inventory ◽  
Finite State ◽  
Cost Functionals

We consider a production-inventory model operating in a stochastic environment that is modulated by a finite state continuous-time Markov chain. When the inventory level reaches zero, an order is placed from an external supplier. The costs (purchasing and holding costs) are modulated by the state at the order epoch time. Applying a matrix analytic approach, fluid flow techniques, and martingales, we develop methods to obtain explicit equations for these cost functionals in the discounted case and under the long-run average criterion. Finally, we extend the model to allow backlogging.

A Fluid EOQ Model with Markovian Environment

2015 ◽  
Vol 52 (02) ◽  
pp. 473-489 ◽  
Author(s):  
Yonit Barron
Keyword(s):  
Continuous Time ◽  
Inventory Level ◽  
Continuous Time Markov Chain ◽  
Holding Costs ◽  
Eoq Model ◽  
Long Run ◽  
Average Criterion ◽  
Production Inventory ◽  
Finite State ◽  
Cost Functionals

We consider a production-inventory model operating in a stochastic environment that is modulated by a finite state continuous-time Markov chain. When the inventory level reaches zero, an order is placed from an external supplier. The costs (purchasing and holding costs) are modulated by the state at the order epoch time. Applying a matrix analytic approach, fluid flow techniques, and martingales, we develop methods to obtain explicit equations for these cost functionals in the discounted case and under the long-run average criterion. Finally, we extend the model to allow backlogging.

scholarly journals A Fluid EOQ Model with Markovian Environment

2015 ◽  
Vol 52 (2) ◽  
pp. 473-489 ◽  
Author(s):  
Yonit Barron
Keyword(s):  
Continuous Time ◽  
Inventory Level ◽  
Continuous Time Markov Chain ◽  
Holding Costs ◽  
Eoq Model ◽  
Long Run ◽  
Average Criterion ◽  
Production Inventory ◽  
Finite State ◽  
Cost Functionals

We consider a production-inventory model operating in a stochastic environment that is modulated by a finite state continuous-time Markov chain. When the inventory level reaches zero, an order is placed from an external supplier. The costs (purchasing and holding costs) are modulated by the state at the order epoch time. Applying a matrix analytic approach, fluid flow techniques, and martingales, we develop methods to obtain explicit equations for these cost functionals in the discounted case and under the long-run average criterion. Finally, we extend the model to allow backlogging.

scholarly journals Movement Improves the Quality of Temporal Perception and Decision Making

2018 ◽  
Author(s):  
Martin Wiener ◽  
Wei Wei Zhou ◽  
Wilsaan Joiner
Keyword(s):  
Decision Making ◽  
Motor System ◽  
Human Subjects ◽  
Response Threshold ◽  
Time Data ◽  
Stimulus Interval ◽  
Experience Of Time ◽  
Average Criterion ◽  
Group A ◽  
Movement Parameters

AbstractRecent evidence suggest that our experience of time is directly and intrinsically computed within the motor system. Accordingly, a variety of studies have demonstrated that concurrent movement impacts the estimate of temporal duration, such that perceived time is shifted towards the duration of movement. In order to investigate the role of the motor system, we tested human subjects (n=40) on a novel task combining reaching and time perception. In this task, subjects were required to move a robotic manipulandum to one of two physical locations to categorize a concurrently timed suprasecond auditory stimulus as “long” or “short”, relative to a running average criterion. Critically, subjects were divided into two groups: one in which movement during the interval was unrestricted and subjects could move freely to their choice, and one in which they were restrained from moving until the stimulus interval had elapsed. Our results revealed a higher degree of precision for subjects in the free-moving group. By further decomposing choice and response time data with a drift diffusion model of decision making, we identified the source of this change to a shift in the response threshold for free-moving subjects. Analysis of movement parameters revealed that eventual choice could be determined by movement parameters (e.g. trajectory, force) before the response was made, and even before the interval had elapsed, and that the variability of these movements was lower in the unrestrained group. A further experiment (n=14) verified that these findings were not due to proximity to the target, counting strategies, bias, or movement length. Our findings suggest that perceptual timing may be instantiated within the motor system as an ongoing readout of timing judgment and confidence.

scholarly journals The Role of Principals and Administrators in Performance Appraisal of School Teachers in Punjab

sjesr ◽  
2020 ◽  
Vol 3 (2) ◽  
pp. 132-142
Author(s):  
Muhammad Nadeem ◽  
Dr. Seema Arif ◽  
Dr. Muhammad Naeem
Keyword(s):  
Performance Appraisal ◽  
School Principals ◽  
Secondary School Principals ◽  
Selection Criterion ◽  
Appraisal System ◽  
Structured Interviews ◽  
District Administrators ◽  
Key Stakeholders ◽  
Average Criterion ◽  
District Administration

Qualitative research was conducted in the interpretive paradigm using phenomenology as an approach to check the execution of the performance appraisal system (PAS) at higher secondary schools in Punjab. The population of the study consisted of key stakeholders of appraisal, higher secondary school principals, teachers, and district administration. 6 out of 36 districts were selected from school district rankings, each falling in poor, good, and average criterion. Participants of one district served as a pilot and the rest for the main study. A total of 35 participants were selected from five districts purposively; a selection criterion was used to select a set of one administrator, one principal and five teachers from each of the five districts. After obtaining consent from the participants, structured interviews were conducted with the school principals and district administrators, while the focus group was held with the teachers of each district using self-constructed interview protocols. Thematic analysis was performed on data obtained from different sources. Seven themes emerged during analysis reflected that the principals and teachers have enough knowledge and experience to conduct the PAS. It is a positive activity that must be continued; however, the procedure needs improvement. PAS should be planned and conducted with the consultation of teachers, motivating them for further improvement.

Detectability of Multiple Flaws

1979 ◽  
Vol 21 (1) ◽  
pp. 7-12 ◽  
Author(s):  
Lewis H. Geyer ◽  
Shantilal Patel ◽  
Ronald F. Perry
Keyword(s):  
Error Rate ◽  
Mixed Condition ◽  
Average Criterion ◽  
Different Types ◽  
Two Measures ◽  
Individual Criterion ◽  
False Rejection ◽  
Criterion Location

Two experiments measured detectability, d', and two measures of criterion location for multiple flaws presented separately versus mixed. In the first experiment, the different flaws were the same in type but differed in magnitude; in the second experiment the flaws were of different types. In Experiment 1 there was no difference in d' for either magnitude of flaw as a result of the separate versus mixed conditions, (i.e., each magnitude of flaw had its own d' in both separate and mixed conditions). However, in Experiment 2 all flaws had lower d's in the mixed condition than when each was presented alone. In neither experiment was there any difference in average criterion location between the separate and mixed conditions, nor did individual criterion locations for easy versus hard flaws presented separately differ in Experiment 1. In Experiment 2 there was a difference in individual criterion locations for the different flaws presented separately, such that for the hardest to detect flaw, false rejection error rate was lower and miss rate higher than for either of the two flaws with larger d's.

Sign in / Sign up

Export Citation Format

Share Document