Teleoperated Vehicle-Perspective Predictive Display Accounting for Network Time Delays

Author(s):  
Jai Prakash ◽  
Michele Vignati ◽  
Stefano Arrigoni ◽  
Mattia Bersani ◽  
Simone Mentasti

Abstract Variable network time-delays in data-transmission is the major problem in tele-operating a vehicle. Even on LTE network, variability of these delays is high (70–150 ms ping). This paper presents an innovative approach of providing the remote operator a forecasted video stream which replicates future perspective of vehicle’s FOV upon reception of maneuvering commands. First, vehicle position is predicted accounting for its speed and data transmission delays. Then perspective image transformation2 is performed to get exact new perspective of vehicle FOV corresponds to the predicted position. This approach addresses both issues, time-delays as well as its variability. Only one display, which shows frontward FOV is availed for mock-up.

2004 ◽  
Vol 13 (1) ◽  
pp. 22-43 ◽  
Author(s):  
Tim Burkert ◽  
Jan Leupold ◽  
Georg Passig

The quality of a teleoperation system is decreased by time delays in the communication channel. Delays as low as a few hundred milliseconds between commanding an action and getting the visual feedback reduce the operator's performance. Predictive displays have proven their suitability to compensate for these delays, but at the expense of image quality when using computer-generated images. A photorealistic predictive display is presented that closes the feedback loop locally at the operator's side of a telepresence system. Photorealism is achieved using delayed camera images for texturing the predicted scene. Consumer graphics hardware is not only used for rendering but also for hardware-accelerated texture extraction. To allow concurrent access to model data, a multibuffer model structure is presented. A model of the teleoperator's environment is automatically acquired and updated by image processing techniques using a stereo camera as the only sensor.


2013 ◽  
Vol 2013 (1) ◽  
pp. 000735-000739
Author(s):  
Christian Boehme ◽  
Andreas Ostmann ◽  
Martin Schneider-Ramelow

Each system is designed to fulfill the desired purpose. It is defined by its inputs, outputs, structure, environment, boundary, and the including elements (subsystems). Due to the ongoing miniaturization and integration the complexity of subsystems increases continuously. This paper is intended to demonstrate the build-up of modular Microsystems. By using the embedding technology, each subsystem (module) is interchangeable and stackable. Therefore, the functionality of the entire system depends solely on the selected modules. Moreover, the enhancement, expansion or redesign can be accomplished by replacing existing or adding new modules. The communication between the individual modules is based on the standardized I2C bus. Additionally, a USB interface has been implemented to manage the data transmission between the embedded camera module and a computer. The whole system recognizes each module and performs accordingly. The user can access sensor values, watch the video stream, and change the parameters of each module via a Graphical User Interface (GUI) on his computer. To achieve the build-up of the modular Microsystems we only used packaged active and passive components. Depending on the complexity of each module a core of up to eight layers is build up. The components are then soldered onto both sides of the core. At this point the components are embedded using a laminating press. The afterwards even surface is then structured again, to enable the stacking of the modules. Each step of the entire assembly process is done via state of the art circuit board processing technologies, including laser drill and laser-direct imaging.


2013 ◽  
Vol 336-338 ◽  
pp. 2494-2499 ◽  
Author(s):  
Rong Jun Chen ◽  
Kai Xie ◽  
Shun Dao Xie ◽  
Xiong Yong Zhu ◽  
Hong Zhou Tan

To reduce the resource consumption in traditional software IPv6 Internet protocols based on embedded system, a data transmission hardware scenario of reduced IPv6 protocol with optimized cache structures based on the FPGA is designed using Verilog HDL. This scenario implements the function of the Transport Layer and the Network Layer on FPGA and uses the function of the Data Link Layer and the Physical Layer on the DM9000A chip, which can perform stateless auto-configuration, address resolution, echo response and UDP transmission. To improve the transmission efficiency, a low-resource-consumption and self-managed cache structure is designed to manage the Neighbor Cache, the Prefix Table and the Default Router Table. In the IPv6 network test, the design can configure itself and its data rate exceeds 28Mbps, which can realize real-time video stream, audio stream and other data transmission in Network of Things applications in IPv6 network.


2002 ◽  
Vol 12 (01) ◽  
pp. 15-29 ◽  
Author(s):  
V. SREE HARI RAO ◽  
P. RAJA SEKHARA RAO

A mathematical model describing the dynamical interactions of bidirectional associative memory networks involving transmission delays is considered. The influence of a dead zone or a zone of noactivation on the global stability is investigated and various easily verifiable sets of sufficient conditions are established. The asymptotic nature of solutions when the given system of equations does not possess an equilibrium pattern is discussed.


Femto cells are miniature wireless telecommunications base stations that can be placed in different inhibited or industry surroundings moreover as single stand-alone substance or in clusters to afford enhanced cellular coverage inside a building. It is extensively known that cellular coverage, predominantly for data transmission where high quality signal strengths are desirable is not as superior within buildings. By using a miniature domestic base station Femto cell, the cellular routine can be enhanced beside with the promising provision of other services. A cognitive radio network time after time detects handy channels in cellular spectrum, and then frequently varies its transmission or receiving parameters to tolerate further synchronized cellular communications in a given cellular electromagnetic band. Conveying of the free channels among main and minor users, in a specific geographic province at the same time as minimizing infringement amongst all users also known as the Spectrum allotment in cognitive radio networks. In this work MBS, FAP and MUs are presented. Here FAP serves the provision of sub channels and provides power in order to maximize the network effectiveness. Finally achieved maximum throughput for the deployed Macro users (MU) and also the above mentioned problem is solved by dual disintegration method.


2018 ◽  
Vol 14 (4) ◽  
pp. 1532-1541 ◽  
Author(s):  
Yu Zhang ◽  
Yuan Jin ◽  
Jianguo Yao ◽  
Guchuan Zhu ◽  
Bin Wen

Sensors ◽  
2020 ◽  
Vol 20 (19) ◽  
pp. 5612
Author(s):  
Benhong Zhang ◽  
Baorui Yuan ◽  
Xiang Bi ◽  
Zhenchun Wei ◽  
Mingyue Zhang

The Internet of Vehicle (IoV) technology is one of the most important technologies of modern intelligent transportation. The data transmission scheduling method is a research hotspot in the technology of IoV. It is a challenge to ensure the stability of data transmission due to fast network topology changes, high data transmission delays, and some other reasons. Aiming at the above problems, a multi-channel data transmission cooperative scheduling algorithm is proposed. First, construct a feasible interference map based on the data items sent and received by vehicles in the road scene. Second, assign channels to the nodes in the interference map based on the Signal-to-Interference-Noise-Ratio (SINR). Finally, the optimal multi-channel data transmission cooperative scheduling scheme is achieved through the ISing model. Simulation results show that compared with the traditional algorithm, the network service capacity is increased by about 31% and the service delay is reduced by about 20%. It ensures that emergency data is preferentially transmitted to the target vehicle and the maximum weighted service capacity of the network.


2017 ◽  
Vol 2017 ◽  
pp. 1-8
Author(s):  
Xinwei Wang ◽  
Guo-Ping Jiang ◽  
Chunxia Fan ◽  
Xu Wu

Topology detection for output-coupling weighted complex dynamical networks with two types of time delays is investigated in this paper. Different from existing literatures, coupling delay and transmission delay are simultaneously taken into account in the output-coupling network. Based on the idea of the state observer, we build the drive-response system and apply LaSalle’s invariance principle to the error dynamical system of the drive-response system. Several convergent criteria are deduced in the form of algebraic inequalities. Some numerical simulations for the complex dynamical network, with node dynamics being chaotic, are given to verify the effectiveness of the proposed scheme.


Sign in / Sign up

Export Citation Format

Share Document