Visual Communication Design Based on Collaborative Wireless Communication Video Transmission

With the development of wireless communication technology, video and multimedia have become an integral part of visual communication design. Designers want higher interactivity, diversity, humanization, and plurality of attributes in the process of visual communication. This makes the process of visual communication have high requirements for the quality and real-time data transmission. To address the problem of transmitting HD video in a heterogeneous wireless network with multiple concurrent streams to improve the transmission rate and thus enhance the user experience, with the optimization goal of minimizing the system transmission delay and the delay difference between paths, the video sender and receiver are jointly considered, and the video transmission rate and the cache size at the receiver are adaptively adjusted to improve the user experience, and a cooperative wireless communication video transmission based on the control model for video transmission based on cooperative wireless communication is established, and video streams with self-similarity and long correlation are studied based on Pareto distribution and P / P / l queuing theory, based on which an adaptive streaming decision method for video streams in heterogeneous wireless networks is proposed. Simulation results show that the proposed multistream concurrent adaptive transmission control method for heterogeneous networks is superior in terms of delay and packet loss rate compared with the general load balancing streaming decision method, in terms of transmission efficiency and accuracy.

Investigating the Use of Head Mounted Devices for Remote Cooperation and Guidance during the Treatment of Wounds

Professional caregivers often face complex situations in which they need the support of a colleague or a specialist. This is especially necessary for caregivers during their training or with less practice in certain tasks. Due to time and space restrictions, colleagues or specialists are not always available for local support. Remote support by streaming videos to a remote helper has been discussed in healthcare domains as a so-called teleconsultation. However, little is known about how to apply teleconsultation in care. We conducted a study with caregivers and remote helpers to compare head mounted devices (HMDs) for teleconsultation in care to two alternative solutions using smartphones. We found that despite lacking familiarity, HMDs have good potential for remote support in care, and that creating video streams with smartphones is not preferable for teleconsultations. We suggest that ideal support needs to balance freedom and guidance and suggest how such support needs to be further explored.

Dissecting Cloud Gaming Performance with DECAF

Cloud gaming platforms have witnessed tremendous growth over the past two years with a number of large Internet companies including Amazon, Facebook, Google, Microsoft, and Nvidia publicly launching their own platforms. While cloud gaming platforms continue to grow, the visibility in their performance and relative comparison is lacking. This is largely due to absence of systematic measurement methodologies which can generally be applied. As such, in this paper, we implement DECAF, a methodology to systematically analyze and dissect the performance of cloud gaming platforms across different game genres and game platforms. DECAF is highly automated and requires minimum manual intervention. By applying DECAF, we measure the performance of three commercial cloud gaming platforms including Google Stadia, Amazon Luna, and Nvidia GeForceNow, and uncover a number of important findings. First, we find that processing delays in the cloud comprise majority of the total round trip delay experienced by users, accounting for as much as 73.54% of total user-perceived delay. Second, we find that video streams delivered by cloud gaming platforms are characterized by high variability of bitrate, frame rate, and resolution. Platforms struggle to consistently serve 1080p/60 frames per second streams across different game genres even when the available bandwidth is 8-20× that of platform's recommended settings. Finally, we show that game platforms exhibit performance cliffs by reacting poorly to packet losses, in some cases dramatically reducing the delivered bitrate by up to 6.6× when loss rates increase from 0.1% to 1%. Our work has important implications for cloud gaming platforms and opens the door for further research on comprehensive measurement methodologies for cloud gaming.

Pandemics, Delays, and Pure Data: on ‘afterlives’ (2020), for Flute and Live Electronics and Visuals

The essay addresses creative and technical aspects of the piece ‘afterlives’ (2020), for flute and live electronics and visuals. Composed and premiered in the context of the COVID-19 pandemic, the composition employs audiovisual processes based on different audiovisual techniques: phase-vocoders, buffer-based granulations, Ambisonics spatialization, and variable delay of video streams. The resulting sounds and images allude to typical situations of social interaction via video conferencing applications. ‘Afterlives’ relies on an interplay between current, almost-current, and past moments of the audiovisual streams, which dephase the performer’s images and sounds. I have avoided, in text, delving deeper into the Pure Data abstractions and or into the musical analysis of my composition. The main purpose of the text is rather to present compositional/technical elements of ‘afterlives’ and discuss how they enable new experiences of time.

A Fast and Accurate Approach to Multiple-Vehicle Localization and Tracking from Monocular Aerial Images

In this work we present a novel end-to-end solution for tracking objects (i.e., vessels), using video streams from aerial drones, in dynamic maritime environments. Our method relies on deep features, which are learned using realistic simulation data, for robust object detection, segmentation and tracking. Furthermore, we propose the use of rotated bounding-box representations, which are computed by taking advantage of pixel-level object segmentation, for improved tracking accuracy, by reducing erroneous data associations during tracking, when combined with the appearance-based features. A thorough set of experiments and results obtained in a realistic shipyard simulation environment, demonstrate that our method can accurately, and fast detect and track dynamic objects seen from a top-view.

Color detection algorithm for early fire diagnostics

In the paper as a problem domain was chosen oil mining and its peculiarities related to early fire diagnostics. Main feature of the described method of early fire diagnostics is application of color detection algorithm together with video sequence acquired from survey cameras. Drawback of the known algorithms of fire diagnostics that also use video streams is selection of the only one color of visible spectrum. Proposed algorithm makes frames preprocessing with purpose of white noise and Gaussian noise suppression. Main feature is complex registration of color components of fire images that are specific to chosen problem domain. Described obtained results of practical application of proposed color detection approach. Experiments were carried out using test video sequences from Bilkent University and Dyntex database. It is shown that advantage of the proposed approach is an ability to select different color components and process them in complex during color detection.

Implementation Method Of Remote Assistance Instruction Based On Hardware Secure Encryption

As a public service enterprise related to energy security and national economy and people’s livelihood, the safe work is related to all walks of life and thousands of households. In power scenarios, the remote cooperative guidance needs to ensure the security of data communication. The implementation method of remote cooperative guidance in power scenarios based on hardware security encryption realizes the functions of terminal registration, user online and offline management, message call, control signaling negotiation, audio and video real-time call, graphic guidance and target tracking and labeling. Configuration TF card encryption at the mobile terminal chip and video server configuration high speed encryption card, WIFI / 4 g wireless networks to establish encryption channel, remote collaborative guidance terminal power scene registration messages, messages, call, and by guiding and structured data security encryption transmission, the unstructured data such as audio stream and video stream is encrypted. It not only realizes the secure encryption of message communication, but also guarantees the high-speed transmission of audio and video streams.

Results of a pilot experiment on monitoring the condition of buildings and structures using unmanned aerial vehicles

The purpose of the experimental study presented in the paper is to generate new knowledge about the possibility of using unmanned aerial vehicles to survey buildings and structures for subsequent extraction of information about their condition in hard-to-reach or remote places. As objects for the pilot experiment, the following were selected: a residential building in an urban environment that has been destroyed during operation; an object of unfinished construction; a roadway on the carriageway. An unmanned aerial vehicle of the model: DJI Mavic Air was used to survey the objects. The results of the study of objects are recorded in the form of photo and video streams for each object. Comparison of the results of the inspection of objects by experts and unmanned aerial vehicles showed the possibility and necessity of using new means to collect information about the condition of buildings and structures. The primary processing of the obtained images revealed their features: the effect of illumination on the color characteristics of the object of study; the presence of a textural component that complicates the process of separating the defect from the background; the presence of objects in the image that are not related to the elements of surface destruction; the change in the initial size of the object over time. The detected features of the images allow the use of standard algorithms and processing and require the synthesis of unique trajectories of their application.

To the question of realization of machine vision technology based on FPGA-architectures

In the last few years, machine learning and machine vision technologies have started to gain more and more popularity. This industry occupies one of the leading positions in the field of information technology. The paper is devoted to the development of a machine vision algorithm based on new generations of FPGAs for recognizing handwritten Cyrillic characters in images and video streams, in particular. The article raises the issues of using FPGA as an image segmentation accelerator and organizing work with the video stream, choosing the most suitable FPGA platform, creating training samples of handwritten characters, and working with the convolutional neural network AlexNet.