Deep learning with accelerated execution: toward a real-time video analysis system

Author(s):  
Yijie Ma ◽  
Zoran Salcic
2020 ◽  
Vol 71 (7) ◽  
pp. 868-880
Author(s):  
Nguyen Hong-Quan ◽  
Nguyen Thuy-Binh ◽  
Tran Duc-Long ◽  
Le Thi-Lan

Along with the strong development of camera networks, a video analysis system has been become more and more popular and has been applied in various practical applications. In this paper, we focus on person re-identification (person ReID) task that is a crucial step of video analysis systems. The purpose of person ReID is to associate multiple images of a given person when moving in a non-overlapping camera network. Many efforts have been made to person ReID. However, most of studies on person ReID only deal with well-alignment bounding boxes which are detected manually and considered as the perfect inputs for person ReID. In fact, when building a fully automated person ReID system the quality of the two previous steps that are person detection and tracking may have a strong effect on the person ReID performance. The contribution of this paper are two-folds. First, a unified framework for person ReID based on deep learning models is proposed. In this framework, the coupling of a deep neural network for person detection and a deep-learning-based tracking method is used. Besides, features extracted from an improved ResNet architecture are proposed for person representation to achieve a higher ReID accuracy. Second, our self-built dataset is introduced and employed for evaluation of all three steps in the fully automated person ReID framework.


2020 ◽  
Vol 9 (3) ◽  
pp. 25-30
Author(s):  
So Yeon Jeon ◽  
Jong Hwa Park ◽  
Sang Byung Youn ◽  
Young Soo Kim ◽  
Yong Sung Lee ◽  
...  

2021 ◽  
Author(s):  
Phuoc Ha Quang ◽  
Phong Pham Thanh ◽  
Tuan Nguyen Van Anh ◽  
Son Vo Phi ◽  
Binh Le Nhat ◽  
...  

Author(s):  
Guillermo Hernández ◽  
Sara Rodríguez ◽  
Angélica González ◽  
Juan Manuel Corchado ◽  
Javier Prieto

2020 ◽  
Vol 71 (7) ◽  
pp. 868-880
Author(s):  
Nguyen Hong Quan ◽  
Nguyen Thuy Binh ◽  
Tran Duc Long ◽  
Le Thi Lan

Along with the strong development of camera networks, a video analysis system has been become more and more popular and has been applied in various practical applications. In this paper, we focus on person re-identification (person ReID) task that is a crucial step of video analysis systems. The purpose of person ReID is to associate multiple images of a given person when moving in a non-overlapping camera network. Many efforts have been made to person ReID. However, most of studies on person ReID only deal with well-alignment bounding boxes which are detected manually and considered as the perfect inputs for person ReID. In fact, when building a fully automated person ReID system the quality of the two previous steps that are person detection and tracking may have a strong effect on the person ReID performance. The contribution of this paper are two-folds. First, a unified framework for person ReID based on deep learning models is proposed. In this framework, the coupling of a deep neural network for person detection and a deep-learning-based tracking method is used. Besides, features extracted from an improved ResNet architecture are proposed for person representation to achieve a higher ReID accuracy. Second, our self-built dataset is introduced and employed for evaluation of all three steps in the fully automated person ReID framework.


Complexity ◽  
2021 ◽  
Vol 2021 ◽  
pp. 1-11
Author(s):  
Peng Yao

This paper focuses on the theme of the application of deep learning in the field of basketball sports, using research methods such as literature research, video analysis, comparative research, and mathematical statistics to explore deep learning in real-time analysis of basketball sports data. The basketball posture action recognition and analysis system proposed for basketball movement is composed of two parts serially. The first part is based on the bottom-up posture estimation method to locate the joint points and is used to extract the posture sequence of the target in the video. The second part is the analysis and research of the action recognition algorithm based on the convolution of the space-time graph. According to the extracted posture sequence, the basketball action of the set classification is recognized. In order to obtain more accurate and three-dimensional information, a multitraining target method can be used in training; that is, multiple indicators can be detected and feedback is provided at the same time to correct player errors in time; the other is an auxiliary method, which is compared with ordinary training. The method can actively correct technical movements, train players to form muscle memory, and improve their abilities. Through the research of this article, it provides a theoretical basis for promoting the application of deep learning in the field of basketball and also provides a theoretical reference for the wider application of deep learning in the field of sports. At the same time, the designed real-time analysis system of basketball data also provides more actual reference values for coaches and athletes.


2012 ◽  
Vol 33 (08) ◽  
pp. 635-640 ◽  
Author(s):  
A. Redwood-Brown ◽  
W. Cranton ◽  
C. Sunderland

2022 ◽  
Vol 355 ◽  
pp. 03036
Author(s):  
Wei Li ◽  
Zhiyuan Han ◽  
Jian Shen ◽  
Dandan Luo ◽  
Bo Gao ◽  
...  

Herein, on the basis of a distributed AI cluster, a real-time video analysis system is proposed for edge computing. With ARM cluster server as the hardware platform, a distributed software platform is constructed. The system is characterized by flexible expansion, flexible deployment, data security, and network bandwidth efficiency, which makes it suited to edge computing scenarios. According to the measurement data, the system is effective in increasing the speed of AI calculation by over 20 times in comparison with the embedded single board and achieving the calculation effect that matches GPU. Therefore, it is considered suited to the application in heavy computing power such as real-time AI computing.


IEEE Access ◽  
2019 ◽  
Vol 7 ◽  
pp. 64186-64197 ◽  
Author(s):  
Qing Song ◽  
Yingqi Wu ◽  
Xueshi Xin ◽  
Lu Yang ◽  
Min Yang ◽  
...  

2020 ◽  
Vol 39 (4) ◽  
pp. 5699-5711
Author(s):  
Shirong Long ◽  
Xuekong Zhao

The smart teaching mode overcomes the shortcomings of traditional teaching online and offline, but there are certain deficiencies in the real-time feature extraction of teachers and students. In view of this, this study uses the particle swarm image recognition and deep learning technology to process the intelligent classroom video teaching image and extracts the classroom task features in real time and sends them to the teacher. In order to overcome the shortcomings of the premature convergence of the standard particle swarm optimization algorithm, an improved strategy for multiple particle swarm optimization algorithms is proposed. In order to improve the premature problem in the search performance algorithm of PSO algorithm, this paper combines the algorithm with the useful attributes of other algorithms to improve the particle diversity in the algorithm, enhance the global search ability of the particle, and achieve effective feature extraction. The research indicates that the method proposed in this paper has certain practical effects and can provide theoretical reference for subsequent related research.


Sign in / Sign up

Export Citation Format

Share Document