Visual Sequence Algorithm for Moving Object Tracking and Detection in Images

Objective. The effects of different algorithms on detecting and tracking moving objects in images based on computer vision technology are studied, and the best algorithm scheme is confirmed. Methods. An automatic moving target detection and tracking algorithm based on the improved frame difference method and mean-shift was proposed to test whether the improved algorithm has improved the detection and tracking effect of moving targets. The algorithm improves the traditional three-frame difference method and introduces a single Gaussian background model to participate in target detection. The improved frame difference method is used to detect the target, and the position window and center of the target are determined. Combined with the mean-shift algorithm, it is determined whether the template needs to be updated according to whether it exceeds the set threshold so that the algorithm can automatically track the moving target. Results. The position and size of the search window change as the target location and size change. The Bhattacharyya similarity measure ρ (y) exceeds the threshold r, and the target detection algorithm is successfully restarted. Conclusion. The algorithm for automatic detection and tracking of moving objects based on the improved frame difference method and mean-shift is fast and has high accuracy.

A Demodulation Algorithm for Periodically In-Plane Vibrating MEMS Based on a Stroboscopic Micro-Visual System

A high-frequency short-pulsed stroboscopic micro-visual system was employed to capture the transient image sequences of a periodically in-plane working micro-electro-mechanical system (MEMS) devices. To demodulate the motion parameters of the devices from the images, we developed the feature point matching (FPM) algorithm based on Speeded-Up Robust Features (SURF). A MEMS gyroscope, vibrating at a frequency of 8.189 kHz, was used as a testing sample to evaluate the performance of the proposed algorithm. Within the same processing time, the SURF-based FPM method demodulated the velocity of the in-plane motion with a precision of 10−5 pixels of the image, which was two orders of magnitude higher than the template-matching and frame-difference algorithms.

The Acquisition of Position and Orientation of the Conveyor Belt Workpiece Based on the Inter Frame Difference in ROI in Camera Video

Conveyor belt transfer is a widely used transportation means in industry and agriculture, with the help of the robot arms the workpiece on the belt can be picked and placed, replacing human sorters for production lines work. The position and orientation of the workpiece are important for grabbing by the robot arms. The goal of the paper was to investigate the acquisition of the position and orientation of the conveyor belt workpiece by means of the camera video overhead looking down the belt. The proposed method is the inter frame difference in nature, using the conveyor belt background as the first frame, but the other frames were not used wholly as usually, only an ROI all around the conveyor belt in the camera video was chosen, and the inter frame difference was carried out in the ROI. The ROI was of the same width as that of the belt in the video which was known in advance, while the length of the ROI was arbitrary, so one pixel in the frame was scaled to the actual length conveniently. Every read frame behind the background was computed the difference with the background in such ROI, and the four vertexes coordinates of the rectangle workpiece image on the belt were obtained when it passed the ROI, and then the distance apart from the right belt boundary was calculated due to the proportional relation between the width of workpiece and that of the ROI. Two kind workpiece orientation on the belt toward the left and right were judged using the same obtained four vertexes coordinates by means of Euclidian length, and the tilt angle was calculated by arc tangent function in favour of two narrow sides of rectangle workpiece grab. The actual test showed that the method of obtaining the position and orientation of workpiece on the belt proposed in the paper could be realized correctly.

Dynamic Shadow Detection and Removal for Vehicle Tracking System

Shadow leads to failure of moving target positioning, segmentation, tracking, and classification in the video surveillance system thus shadow detection and removal is essential for further computer vision process. The existing state-of-the-art methods for dynamic shadow detection have produced a high discrimination rate but a poor detection rate (foreground pixels are classified as shadow pixels). This paper proposes an effective method for dynamic shadow detection and removal based on intensity ratio along with frame difference, gamma correction, and morphology operations. The performance of the proposed method has been tested on two outdoor ATON datasets, namely, highway-I and highway-III for vehicle tracking systems. The proposed method has produced a discrimination rate of 89.07% and a detection rate of 80.79% for highway-I video sequences. Similarly, for a highway-III video sequence, the discrimination rate of 85.60% and detection rate of 84.05% have been obtained. Investigational outcomes show that the proposed method is the simple, steadiest, and robust for dynamic shadow detection on the dataset used in this work.

COVID-19 Diagnosis by 5-second Facial Video Processing Using Vibraimage and Artificial Intelligence

The Covid-19 pandemic spreads in waves for a year and a half, despite significant worldwide efforts, the development of biochemical diagnostic methods and population vaccination. One of the reasons for the infection spread is the impossibility of early disease detection through biochemical diagnostics, since biochemical processes slowly develop in a body. At the same time, well known that behavioral characteristics of a person, measured based on reflex movements, are capable for inertialess assessment of psychophysiological parameters. Vibraimage technology is the method of head micromovements video processing by inter-frame difference accumulation and converting spatial and temporal characteristics of the inter-frame difference into behavioral and psychophysiological parameters. Here we shown that behavioral parameters measured by vibraimage changed during COVID-19 infection. The identification of changes signs in behavioral parameters detected by AI trained on patients and controls. The best diagnostic accuracy (higher 94%) obtained using instantaneous values of behavioral parameters measured with the following vibraimage settings: 10Hz frequency of basic measurements; 25 inter-frame difference accumulations and averaging the diagnostic results over period of at least 5 seconds. COVID-19 diagnoses by behavioral parameters showed earlier (5-7 days) detection of the disease compared to symptoms and positive results of biochemical RT-PCR testing. Proposed method for COVID-19 diagnosis indicates infected persons within 5 seconds video processing using standard television cameras (web, IP) and computers, allows mass testing/selftesting and will stop the pandemic spread. We assume that head micromovements analysis for diagnosis of various diseases is possible not only with the help of vibraimage technology. Further research of human head micromovement analysis will help stop the COVID-19 pandemic and will contribute to the development of new contactless and environmentally friendly methods for early diagnosis of diseases.

Optimization Research on Deep Learning and Temporal Segmentation Algorithm of Video Shot in Basketball Games

The analysis of the video shot in basketball games and the edge detection of the video shot are the most active and rapid development topics in the field of multimedia research in the world. Video shots’ temporal segmentation is based on video image frame extraction. It is the precondition for video application. Studying the temporal segmentation of basketball game video shots has great practical significance and application prospects. In view of the fact that the current algorithm has long segmentation time for the video shot of basketball games, the deep learning model and temporal segmentation algorithm based on the histogram for the video shot of the basketball game are proposed. The video data is converted from the RGB space to the HSV space by the boundary detection of the video shot of the basketball game using deep learning and processing of the image frames, in which the histogram statistics are used to reduce the dimension of the video image, and the three-color components in the video are combined into a one-dimensional feature vector to obtain the quantization level of the video. The one-dimensional vector is used as the variable to perform histogram statistics and analysis on the video shot and to calculate the continuous frame difference, the accumulated frame difference, the window frame difference, the adaptive window’s mean, and the superaverage ratio of the basketball game video. The calculation results are combined with the set dynamic threshold to optimize the temporal segmentation of the video shot in the basketball game. It can be seen from the comparison results that the effectiveness of the proposed algorithm is verified by the test of the missed detection rate of the video shots. According to the test result of the split time, the optimization algorithm for temporal segmentation of the video shot in the basketball game is efficiently implemented.