Structure-preserving video super-resolution using three-dimensional convolutional neural networks

2019 ◽  
Vol 28 (02) ◽  
pp. 1
Author(s):  
Chenyu Liu ◽  
Xueming Li ◽  
Xianlin Zhang ◽  
Xuewei Li
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Three Dimensional ◽  
Super Resolution ◽  
Structure Preserving

Efficient downscaling of satellite oceanographic data with convolutional neural networks

2021 ◽  
Vol 12 (3) ◽  
pp. 46-47
Author(s):  
Nikita Saxena
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Super Resolution ◽  
Sea Surface ◽  
Clear Sky ◽  
Oceanographic Data ◽  
Computationally Expensive ◽  
Sky Conditions ◽  
Data Inference

Space-borne satellite radiometers measure Sea Surface Temperature (SST), which is pivotal to studies of air-sea interactions and ocean features. Under clear sky conditions, high resolution measurements are obtainable. But under cloudy conditions, data analysis is constrained to the available low resolution measurements. We assess the efficiency of Deep Learning (DL) architectures, particularly Convolutional Neural Networks (CNN) to downscale oceanographic data from low spatial resolution (SR) to high SR. With a focus on SST Fields of Bay of Bengal, this study proves that Very Deep Super Resolution CNN can successfully reconstruct SST observations from 15 km SR to 5km SR, and 5km SR to 1km SR. This outcome calls attention to the significance of DL models explicitly trained for the reconstruction of high SR SST fields by using low SR data. Inference on DL models can act as a substitute to the existing computationally expensive downscaling technique: Dynamical Downsampling. The complete code is available on this Github Repository.

scholarly journals RSPCN: Super-Resolution of Digital Elevation Model Based on Recursive Sub-Pixel Convolutional Neural Networks

2021 ◽  
Vol 10 (8) ◽  
pp. 501
Author(s):  
Ruichen Zhang ◽  
Shaofeng Bian ◽  
Houpu Li
Keyword(s):  
Neural Networks ◽  
Digital Elevation Model ◽  
Convolutional Neural Networks ◽  
Adaptive Learning ◽  
Nearest Neighbor ◽  
Super Resolution ◽  
Recursion Theory ◽  
Research Issues ◽  
Digital Elevation ◽  
Elevation Model

The digital elevation model (DEM) is known as one kind of the most significant fundamental geographical data models. The theory, method and application of DEM are hot research issues in geography, especially in geomorphology, hydrology, soil and other related fields. In this paper, we improve the efficient sub-pixel convolutional neural networks (ESPCN) and propose recursive sub-pixel convolutional neural networks (RSPCN) to generate higher-resolution DEMs (HRDEMs) from low-resolution DEMs (LRDEMs). Firstly, the structure of RSPCN is described in detail based on recursion theory. This paper explores the effects of different training datasets, with the self-adaptive learning rate Adam algorithm optimizing the model. Furthermore, the adding-“zero” boundary method is introduced into the RSPCN algorithm as a data preprocessing method, which improves the RSPCN method’s accuracy and convergence. Extensive experiments are conducted to train the method till optimality. Finally, comparisons are made with other traditional interpolation methods, such as bicubic, nearest-neighbor and bilinear methods. The results show that our method has obvious improvements in both accuracy and robustness and further illustrate the feasibility of deep learning methods in the DEM data processing area.

scholarly journals Generation and Annotation of Simulation-Real Ship Images for Convolutional Neural Networks Training and Testing

2021 ◽  
Vol 11 (13) ◽  
pp. 5931
Author(s):  
Ji’an You ◽  
Zhaozheng Hu ◽  
Chao Peng ◽  
Zhiqiang Wang
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Image Annotation ◽  
Three Dimensional ◽  
Image Data ◽  
Detection Algorithm ◽  
Simulation Software ◽  
High Quality ◽  
Annotation Method ◽  
Detection Of Objects

Large amounts of high-quality image data are the basis and premise of the high accuracy detection of objects in the field of convolutional neural networks (CNN). It is challenging to collect various high-quality ship image data based on the marine environment. A novel method based on CNN is proposed to generate a large number of high-quality ship images to address this. We obtained ship images with different perspectives and different sizes by adjusting the ships’ postures and sizes in three-dimensional (3D) simulation software, then 3D ship data were transformed into 2D ship image according to the principle of pinhole imaging. We selected specific experimental scenes as background images, and the target ships of the 2D ship images were superimposed onto the background images to generate “Simulation–Real” ship images (named SRS images hereafter). Additionally, an image annotation method based on SRS images was designed. Finally, the target detection algorithm based on CNN was used to train and test the generated SRS images. The proposed method is suitable for generating a large number of high-quality ship image samples and annotation data of corresponding ship images quickly to significantly improve the accuracy of ship detection. The annotation method proposed is superior to the annotation methods that label images with the image annotation software of Label-me and Label-img in terms of labeling the SRS images.

scholarly journals Identification of Mode Shapes of a Composite Cylinder Using Convolutional Neural Networks

Materials ◽  
2021 ◽  
Vol 14 (11) ◽  
pp. 2801
Author(s):  
Bartosz Miller ◽  
Leonard Ziemiański
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Composite Structures ◽  
Three Dimensional ◽  
Mode Shapes ◽  
Identification Algorithm ◽  
Material Degradation ◽  
Local Material ◽  
Noisy Input ◽  
Shape Vector

The aim of the following paper is to discuss a newly developed approach for the identification of vibration mode shapes of multilayer composite structures. To overcome the limitations of the approaches based on image analysis (two-dimensional structures, high spatial resolution of mode shapes description), convolutional neural networks (CNNs) are applied to create a three-dimensional mode shapes identification algorithm with a significantly reduced number of mode shape vector coordinates. The CNN-based procedure is accurate, effective, and robust to noisy input data. The appearance of local damage is not an obstacle. The change of the material and the occurrence of local material degradation do not affect the accuracy of the method. Moreover, the application of the proposed identification method allows identifying the material degradation occurrence.

A Fast View Synthesis Implementation Method for Light Field Applications

2021 ◽  
Vol 17 (4) ◽  
pp. 1-20
Author(s):  
Wei Gao ◽  
Linjie Zhou ◽  
Lvfang Tao
Keyword(s):  
Neural Networks ◽  
Light Field ◽  
Three Dimensional ◽  
Super Resolution ◽  
View Synthesis ◽  
Compact Representation ◽  
Light Weight ◽  
Computationally Efficient ◽  
Full Resolution ◽  
Time Systems

View synthesis (VS) for light field images is a very time-consuming task due to the great quantity of involved pixels and intensive computations, which may prevent it from the practical three-dimensional real-time systems. In this article, we propose an acceleration approach for deep learning-based light field view synthesis, which can significantly reduce calculations by using compact-resolution (CR) representation and super-resolution (SR) techniques, as well as light-weight neural networks. The proposed architecture has three cascaded neural networks, including a CR network to generate the compact representation for original input views, a VS network to synthesize new views from down-scaled compact views, and a SR network to reconstruct high-quality views with full resolution. All these networks are jointly trained with the integrated losses of CR, VS, and SR networks. Moreover, due to the redundancy of deep neural networks, we use the efficient light-weight strategy to prune filters for simplification and inference acceleration. Experimental results demonstrate that the proposed method can greatly reduce the processing time and become much more computationally efficient with competitive image quality.

Sign in / Sign up

Export Citation Format

Share Document