Markov Processes and Controlled Markov Chains

2002 ◽  
Keyword(s):  
Markov Chains ◽  
Markov Processes ◽  
Controlled Markov Chains

scholarly journals Probability Models for Assessing Effectiveness of Advertising Channels in the Internet Environment

2018 ◽  
pp. 209-215
Keyword(s):  
Graph Theory ◽  
Markov Chains ◽  
Markov Processes ◽  
The Internet ◽  
Probability Models ◽  
Method Of Calculation ◽  
Internet Environment ◽  
The Impact ◽  
Theory Of Graphs ◽  
Selection Of

Nowadays, marketing specialists simultaneously use several channels to attract visitors to websites. There is a difficulty in assessing not only the efficiency and conversion of each channel separately, but also in their interconnection. The problem occurs when users visit a website from several sources and only after that do the key action. To assess the effectiveness and selection of the most optimal channels, different models of attribution are used. The models are reviewed in the article. However, we propose to use multi-channel attribution, which provides an aggregate assessment of multi-channel sequences, taking into account that they are interdependent. The purpose of the paper is to create an attribution model that comprehensively evaluates multi-channel sequences and shows the effect of each channel on the conversion. The presented model of attribution can be based on the theory of graphs or Markov chains. The first method of calculation is more visual, the second (based on Markov chains) allows for work with a large amount of data. As a result, a model of multi-channel attribution was presented, which is based on Markov processes or graph theory. It allows for maximum comprehensive assessing of the impact of each channel on the conversion. On the basis of the two methods, calculations were carried out, confirming the adequacy of the model used for the tasks assigned.

scholarly journals Open quantum random walks, quantum Markov chains and recurrence

2019 ◽  
Vol 31 (07) ◽  
pp. 1950020 ◽  
Author(s):  
Ameur Dhahri ◽  
Farrukh Mukhamedov
Keyword(s):  
Markov Chains ◽  
Random Walks ◽  
Markov Processes ◽  
Transition Operator ◽  
Quantum Random Walks ◽  
Open Quantum ◽  
Commutative Subalgebra ◽  
Open Quantum Random Walks ◽  
Quantum Markov Chains

In the present paper, we construct QMCs (Quantum Markov Chains) associated with Open Quantum Random Walks such that the transition operator of the chain is defined by OQRW and the restriction of QMC to the commutative subalgebra coincides with the distribution [Formula: see text] of OQRW. This sheds new light on some properties of the measure [Formula: see text]. As an example, we simply mention that the measure can be considered as a distribution of some functions of certain Markov processes. Furthermore, we study several properties of QMC and associated measures. A new notion of [Formula: see text]-recurrence of QMC is studied, and the relations between the concepts of recurrence introduced in this paper and the existing ones are established.

scholarly journals Limit Theorems for Semi-Markov Processes and Renewal Theory for Markov Chains

1978 ◽  
Vol 6 (5) ◽  
pp. 788-797 ◽  
Author(s):  
K. B. Athreya ◽  
D. McDonald ◽  
P. Ney
Keyword(s):  
Markov Chains ◽  
Markov Processes ◽  
Limit Theorems ◽  
Renewal Theory ◽  
Semi Markov Processes

Multiple Model-Based Control Using Finite Controlled Markov Chains

2009 ◽  
Vol 1 (3) ◽  
pp. 234-243 ◽  
Author(s):  
Enso Ikonen ◽  
Kaddour Najim
Keyword(s):  
Markov Chains ◽  
Multiple Model ◽  
Model Based Control ◽  
Model Based ◽  
Controlled Markov Chains
Sign in / Sign up

Export Citation Format

Share Document