Comparison of optimized Markov Decision Process using Dynamic Programming and Temporal Differencing – A reinforcement learning approach

Reinforcement learning is one of the promising approaches for operations research problems. The incoming inspection process in any manufacturing plant aims to control quality, reduce manufacturing costs, eliminate scrap, and process failure downtimes due to non-conforming raw materials. Prediction of the raw material acceptance rate can regulate the raw material supplier selection and improve the manufacturing process by filtering out non-conformities. This paper presents a Markov model developed to estimate the probability of the raw material being accepted or rejected in an incoming inspection environment. The proposed forecasting model is further optimized for efficiency using the two reinforcement learning algorithms (dynamic programming and temporal differencing). The results of the two optimized models are compared, and the findings are discussed.

Statistical accuracy analysis of different detecting algorithms for surveillance system in smart city

<span>Several detecting algorithms are developed for real-time surveillance systems in the smart cities. The most popular algorithms due to its accuracy are: Temporal Differencing, Background Subtraction, and Gaussian Mixture Models. Selecting of which algorithm is the best to be used, based on accuracy, is a good choise, but is not the best. Statistical accuracy anlysis tests are required for achieving a confident decision. This paper presents further analysis of the accuracy by employing four parameters: false recognition, unrecognized, true recognition, and total fragmentation ratios. The results proof that no algorithm is selected as the perfect or suitable for all applications based on the total fragmentation ratio, whereas both false recognition ratio and unrecognized ratio parameters have a significant impact. The mlti-way Analysis of Variate (so-called K-way ANONVA) is used for proofing the results based on SPSS statistics.</span>

Rapid video assessment for monitoring testing facility fraud

Purpose The purpose of this paper is to present a procedure for finding unusual patterns in accredited tests using a rapid processing method for analyzing video records. The procedure uses the temporal differencing technique for object tracking and considers only frames not identified as statistically redundant. Design/methodology/approach An accreditation organization is responsible for accrediting facilities to undertake testing and calibration activities. Periodically, such organizations evaluate accredited testing facilities. These evaluations could use video records and photographs of the tests performed by the facility to judge their conformity to technical requirements. To validate the proposed procedure, a real-world data set with video records from accredited testing facilities in the field of vehicle safety in Brazil was used. The processing time of this proposed procedure was compared with the time needed to process the video records in a traditional fashion. Findings With an appropriate threshold value, the proposed procedure could successfully identify video records of fraudulent services. Processing time was faster than when a traditional method was employed. Originality/value Manually evaluating video records is time consuming and tedious. This paper proposes a procedure to rapidly find unusual patterns in videos of accredited tests with a minimum of manual effort.