Distributed Video Coding and Content Analysis for Resource Constraint Multimedia Applications

2012 ◽  
pp. 251-273
Author(s):  
Praveen Kumar ◽  
Amit Pande ◽  
Ankush Mittal ◽  
Abhisek Mudgal
Keyword(s):  
Video Coding ◽  
Real Time ◽  
Video Processing ◽  
Mobile Agents ◽  
Video Transmission ◽  
Moving Objects ◽  
Individual Case ◽  
Multimedia Applications ◽  
Real Time Processing ◽  
Laboratory Setup

Video coding and analysis for low power and low bandwidth multimedia applications has always been a great challenge. The limited computational resources on ubiquitous multimedia devices like cameras along with low and varying bandwidth over wireless network lead to serious bottlenecks in delivering real-time streaming of videos for such applications. This work presents a Content-based Network-adaptive Video-transmission (CbNaVt) framework which can waive off the requirements of low bandwidth. This is done by transmitting important content only to the end user. The framework is illustrated with the example of video streaming in the context of remote laboratory setup. A framework for distributed processing using mobile agents is discussed with the example of Distributed Video Surveillance (DVS). In this regard, the increased computational costs due to video processing tasks like object segmentation and tracking are shared by the cameras and a local base station called as Processing Proxy Server (PPS).However, in a distributed scenario like traffic surveillance, where moving objects is tracked using multiple cameras, the processing tasks needs to be dynamically distributed. This is done intelligently using mobile agents by migrating from one PPS to another for tracking an individual case object and transmitting required information to the end users. Although the authors propose a specific implementation for CbNaVt and DVS systems, the general ideas in design of such systems exemplify the way information can be intelligently transmitted in any ubiquitous multimedia applications along with the use of mobile agents for real-time processing and retrieval of video signal.

scholarly journals Research on Key Technology of Real-time Video Transmission Based on Mobile Terminal

1970 ◽  
Vol 1 (2) ◽  
Author(s):  
Cao Pengfei
Keyword(s):  
Video Coding ◽  
Real Time ◽  
Video Transmission ◽  
Loss Rate ◽  
Signal To Noise Ratio ◽  
Mobile Terminal ◽  
Frame Rate ◽  
Minimum Requirement ◽  
Encapsulation Method ◽  
Real Time Transmission

In order to solve the problems existing in real-time video transmission of mobile terminals, this paper proposes the encapsulation method which is suitable for H.263 and H.264 video coding, and re- duces the extra waste of real-time transmission proto- col packets and to improve the transmission efficien- cy of the video. Experimental results show that the peak signal to noise ratio (PSNR) in H.263 and H.264 video coding mode is above 30 dB at the lowest frame rate and resolution, and the minimum requirement of video transmission has been satisfied. Rate of 24 Hz, the two encoding PSNR are more than 40 dB, videotransmission quality ideal. In addition, the two packet loss rate of about10%maximum, themaximumdelay of 400 ms or less, have reached the requirements of real-time videotransmission.

Multi-Standards Deblocking Filter Based SIMD Technology

2013 ◽  
Vol 791-793 ◽  
pp. 1501-1505
Author(s):  
Tao Jia
Keyword(s):  
Parallel Computing ◽  
Video Coding ◽  
Real Time ◽  
Video Processing ◽  
Hardware Accelerators ◽  
Clock Frequency ◽  
Deblocking Filter ◽  
Filtering Algorithm ◽  
Filter Structure ◽  
Coding Standards

Due to real-time video decoding requirements, hardware accelerators for video deblocking filtering has gradually become a research hotspot in recent years. Compared with the traditional deblocking filter hardware accelerators which support only single video coding standard, this paper implemented a deblocking filter structure, which filtering algorithm can be configured to support multiple video coding standards; Using SIMD technology to make filtering data fully parallel computing. This structure is a multi-standard deblocking filter accelerator, supports H264, AVS, VP8 to, RealVideo, four kinds of video coding standards. The clock frequency is 200MHz, and it can be used for real-time filtering of multi-standard HD video processing. Deblocking Filter Algorithm

scholarly journals FPGA-Based Stereo-Vision System Mimicking Human Binocular Vision

2021 ◽  
Author(s):  
Gvarami Labartkava
Keyword(s):  
Real Time ◽  
Binocular Vision ◽  
Video Processing ◽  
High Performance ◽  
Moving Objects ◽  
Peripheral Vision ◽  
Vision System ◽  
Processing System ◽  
Object Motion ◽  
Human Vision

Human vision is a complex system which involves processing frames and retrieving information in a real-time with optimization of the memory, energy and computational resources usage. It can be widely utilized in many real-world applications from security systems to space missions. The research investigates fundamental principles of human vision and accordingly develops a FPGA-based video processing system with binocular vision, capable of high performance and real-time tracking of moving objects in 3D space. The undertaken research and implementation consist of: 1. Analysis of concepts and methods of human vision system; 2. Development stereo and peripheral vision prototype of a system-on-programmable chip (SoPC) for multi-object motion detection and tracking; 3. Verification, test run and analysis of the experimental results gained on the prototype and associated with the performance constraints; The implemented system proposes a platform for real-time applications which are limited in current approaches.

scholarly journals Energy-Efficient NoC-Based Systems for Real-Time Multimedia Applications using Approximate Computing

2021 ◽  
Author(s):  
Wagner I. Penny ◽  
Daniel M. Palomino ◽  
Marcelo S. Porto ◽  
Bruno Zatt
Keyword(s):  
Real Time ◽  
Video Processing ◽  
Energy Efficient ◽  
Processing System ◽  
Schedulability Analysis ◽  
Multimedia Applications ◽  
Timing Constraints ◽  
Approximate Computing ◽  
Processing Elements ◽  
Fractional Motion Estimation

This work presents an energy-efficient NoC-based system for real-time multimedia applications employing approximate computing. The proposed video processing system, called SApp-NoC, is efficient in both energy and quality (QoS), employing a scalable NoC architecture composed of processing elements designed to accelerate the HEVC Fractional Motion Estimation (FME). Two solutions are proposed: HSApp-NoC (Heuristc-based SApp-NoC), and MLSApp-NoC (Machine Learning-based SApp-NoC). When compared to a precise solution processing 4K videos at 120 fps, HSApp-NoC and MLSApp-NoC reduce about 48.19% and 31.81% the energy consumption, at small quality reduction of 2.74% and 1.09%, respectively. Furthermore, a set of schedulability analysis is also proposed in order to guarantee the meeting of timing constraints at typical workload scenarios.

scholarly journals A Novel Method of Near-Miss Event Detection with Software Defined RADAR in Improving Railyard Safety

Safety ◽  
2019 ◽  
Vol 5 (3) ◽  
pp. 55 ◽  
Author(s):  
Subharthi Banerjee ◽  
Jose Santos ◽  
Michael Hempel ◽  
Pejman Ghasemzadeh ◽  
Hamid Sharif
Keyword(s):  
Real Time ◽  
Visual Processing ◽  
Moving Objects ◽  
Weather Conditions ◽  
Near Miss ◽  
Rolling Stock ◽  
Blind Detection ◽  
Real Time Processing ◽  
Number Of Factors ◽  
Novel Algorithms

Railyards are one of the most challenging and complex workplace environments in any industry. Railyard workers are constantly surrounded by dangerous moving objects, in a noisy environment where distractions can easily result in accidents or casualties. Throughout the years, yards have been contributing 20–30% of the total accidents that happen in railroads. Monitoring the railyard workspace to keep personnel safe from falls, slips, being struck by large object, etc. and preventing fatal accidents can be particularly challenging due to the sheer number of factors involved, such as the need to protect a large geographical space, the inherent dynamicity of the situation workers find themselves in, the presence of heavy rolling stock, blind spots, uneven surfaces and a plethora of trip hazards, just to name a few. Since workers spend the majority of time outdoors, weather conditions also play an important role, i.e., snow, fog, rain, etc. Conventional sensor deployments in yards thus fail to consistently monitor this workspace. In this paper, the authors have identified these challenges and addressed them with a novel detection method using a multi-sensor approach. They have also proposed novel algorithms to detect, classify and remotely monitor Employees-on-Duty (EoDs) without hindering real-time decision-making of the EoD. In the proposed solution, the authors have used a fast spherical-to-rectilinear transform algorithm on fish-eye images to monitor a wide area and to address blindspots in visual monitoring, and employed Software-Defined RADAR (SDRADAR) to address the low-visibility problem. The sensors manage to monitor the workspace for 100 m with blind detection and classification. These algorithms have successfully maintained real-time processing delay of ≤0.1 s between consecutive frames for both SDRADAR and visual processing.

scholarly journals Real Time Tracking RGB Color Based Kinect

2017 ◽  
Vol 11 (3) ◽  
pp. 98
Author(s):  
Ahmed Mustafa Taha Alzbier ◽  
Hang Cheng
Keyword(s):  
Computer Vision ◽  
Real Time ◽  
Video Processing ◽  
Background Subtraction ◽  
Moving Objects ◽  
Blue Color ◽  
The Real ◽  
Color Recognition ◽  
Kinect Camera ◽  
Computer Vision Technology

As the present computer vision technology is growing up, and the multiple RGB color object tracking is considered as one of the important tasks in computer vision and technique that can be used in many applications such as surveillance in a factory production line, event organization, flow control application, analysis and sort by colors and etc. In video processing applications, variants of the background subtraction method are broadly used for the detection of moving objects in video sequences. The background subtraction is the most popular and common approach for motion detection. However , this is paper presents our investigation the first objective of the whole algorithm chain is to find the RGB color within a video. The idea from the beginning was to look for certain specific features of the patches, which would allow distinguishing red, green and blue color objects in the image. In this paper an algorithm is proposed to track the real time moving RGB color objects using kinect camera. We will use a kinect camera to capture the real time video and making an image frame from this video and extracting red, green and blue color .Here image processing is done through MATLAB for color recognition process each color. Our method can tracking accurately at 95% in real-time.

scholarly journals Real-time algorithm for Poissonian noise reduction in low-dose fluoroscopy: performance evaluation

2019 ◽  
Vol 18 (1) ◽  
Author(s):  
A. Sarno ◽  
E. Andreozzi ◽  
D. De Caro ◽  
G. Di Meo ◽  
A. G. M. Strollo ◽  
...  
Keyword(s):  
Image Quality ◽  
Real Time ◽  
Video Processing ◽  
Moving Objects ◽  
Quantum Noise ◽  
Moving Average ◽  
Threshold Level ◽  
Computational Time ◽  
X Ray ◽  
Mask Size

Abstract Background Quantum noise intrinsically limits the quality of fluoroscopic images. The lower is the X-ray dose the higher is the noise. Fluoroscopy video processing can enhance image quality and allows further patient’s dose lowering. This study aims to assess the performances achieved by a Noise Variance Conditioned Average (NVCA) spatio-temporal filter for real-time denoising of fluoroscopic sequences. The filter is specifically designed for quantum noise suppression and edge preservation. It is an average filter that excludes neighborhood pixel values exceeding noise statistic limits, by means of a threshold which depends on the local noise standard deviation, to preserve the image spatial resolution. The performances were evaluated in terms of contrast-to-noise-ratio (CNR) increment, image blurring (full width of the half maximum of the line spread function) and computational time. The NVCA filter performances were compared to those achieved by simple moving average filters and the state-of-the-art video denoising block matching-4D (VBM4D) algorithm. The influence of the NVCA filter size and threshold on the final image quality was evaluated too. Results For NVCA filter mask size of 5 × 5 × 5 pixels (the third dimension represents the temporal extent of the filter) and a threshold level equal to 2 times the local noise standard deviation, the NVCA filter achieved a 10% increase of the CNR with respect to the unfiltered sequence, while the VBM4D achieved a 14% increase. In the case of NVCA, the edge blurring did not depend on the speed of the moving objects; on the other hand, the spatial resolution worsened of about 2.2 times by doubling the objects speed with VBM4D. The NVCA mask size and the local noise-threshold level are critical for final image quality. The computational time of the NVCA filter was found to be just few percentages of that required for the VBM4D filter. Conclusions The NVCA filter obtained a better image quality compared to simple moving average filters, and a lower but comparable quality when compared with the VBM4D filter. The NVCA filter showed to preserve edge sharpness, in particular in the case of moving objects (performing even better than VBM4D). The simplicity of the NVCA filter and its low computational burden make this filter suitable for real-time video processing and its hardware implementation is ready to be included in future fluoroscopy devices, offering further lowering of patient’s X-ray dose.

scholarly journals Integrated UAV-Based Real-Time Mapping for Security Applications

2019 ◽  
Vol 8 (5) ◽  
pp. 219 ◽  
Author(s):  
Daniel Hein ◽  
Thomas Kraft ◽  
Jörg Brauchle ◽  
Ralf Berger
Keyword(s):  
Real Time ◽  
Video Transmission ◽  
Radio Link ◽  
Camera System ◽  
Tool Chain ◽  
Real Time Processing ◽  
Security Applications ◽  
Ground Station ◽  
Remote Sensing Systems ◽  
Original Size

Security applications such as management of natural disasters and man-made incidents crucially depend on the rapid availability of a situation picture of the affected area. UAV-based remote sensing systems may constitute an essential tool for capturing aerial imagery in such scenarios. While several commercial UAV solutions already provide acquisition of high quality photos or real-time video transmission via radio link, generating instant high-resolution aerial maps is still an open challenge. For this purpose, the article presents a real-time processing tool chain, enabling generation of interactive aerial maps during flight. Key element of this tool chain is the combination of the Terrain Aware Image Clipping (TAC) algorithm and 12-bit JPEG compression. As a result, the data size of a common scenery can be reduced to approximately 0.4% of the original size, while preserving full geometric and radiometric resolution. Particular attention was paid to minimize computational costs to reduce hardware requirements. The full workflow was demonstrated using the DLR Modular Airborne Camera System (MACS) operated on a conventional aircraft. In combination with a commercial radio link, the latency between image acquisition and visualization in the ground station was about 2 s. In addition, the integration of a miniaturized version of the camera system into a small fixed-wing UAV is presented. It is shown that the described workflow is efficient enough to instantly generate image maps even on small UAV hardware. Using a radio link, these maps can be broadcasted to on-site operation centers and are immediately available to the end-users.

Multimedia Transmission Technology Research Based on Multicasting

2011 ◽  
Vol 187 ◽  
pp. 383-388
Author(s):  
Shao Huang ◽  
Shu Rong Wang ◽  
Yu Liang Tang
Keyword(s):  
Real Time ◽  
Video Transmission ◽  
Transmission System ◽  
Multimedia Applications ◽  
Multimedia Transmission ◽  
Technology Research ◽  
Basic Principles ◽  
Multicast Transmission ◽  
Real Time Transmission

The paper studied the basic principles of the RTP/RTCP protocol in real-time transmission of multimedia applications, explained the basic applications of multicast technology in stream transmission and put forward a real-time video transmission system combined with DirectShow technology. Then, it presented the details of the multicast transmission of multimedia files in the process through the RTP protocol.

Sign in / Sign up

Export Citation Format

Share Document