scholarly journals Mosaic Super-resolution via Sequential Feature Pyramid Networks

2019 ◽  
Author(s):  
Mehrdad Shoeiby ◽  
Mohammad Ali Armin ◽  
Sadegh Aliakbarian ◽  
Saeed Anwar ◽  
Lars petersson
Keyword(s):  
State Of The Art ◽  
Super Resolution ◽  
Autonomous Driving ◽  
Single Shot ◽  
Current State ◽  
Wide Range ◽  
Feature Pyramid ◽  
Novel Method ◽  
Convolutional Lstm ◽  
Mosaic Images

<div>Advances in the design of multi-spectral cameras have</div><div>led to great interests in a wide range of applications, from</div><div>astronomy to autonomous driving. However, such cameras</div><div>inherently suffer from a trade-off between the spatial and</div><div>spectral resolution. In this paper, we propose to address</div><div>this limitation by introducing a novel method to carry out</div><div>super-resolution on raw mosaic images, multi-spectral or</div><div>RGB Bayer, captured by modern real-time single-shot mo-</div><div>saic sensors. To this end, we design a deep super-resolution</div><div>architecture that benefits from a sequential feature pyramid</div><div>along the depth of the network. This, in fact, is achieved</div><div>by utilizing a convolutional LSTM (ConvLSTM) to learn the</div><div>inter-dependencies between features at different receptive</div><div>fields. Additionally, by investigating the effect of different</div><div>attention mechanisms in our framework, we show that a</div><div>ConvLSTM inspired module is able to provide superior at-</div><div>tention in our context. Our extensive experiments and anal-</div><div>yses evidence that our approach yields significant super-</div><div>resolution quality, outperforming current state-of-the-art</div><div>mosaic super-resolution methods on both Bayer and multi-</div><div>spectral images. Additionally, to the best of our knowledge,</div><div>our method is the first specialized method to super-resolve</div><div>mosaic images, whether it be multi-spectral or Bayer.</div><div><br></div>

scholarly journals Mosaic Super-resolution via Sequential Feature Pyramid Networks

2019 ◽  
Author(s):  
Mehrdad Shoeiby ◽  
Mohammad Ali Armin ◽  
Sadegh Aliakbarian ◽  
Saeed Anwar ◽  
Lars petersson
Keyword(s):  
State Of The Art ◽  
Super Resolution ◽  
Autonomous Driving ◽  
Single Shot ◽  
Current State ◽  
Wide Range ◽  
Feature Pyramid ◽  
Novel Method ◽  
Convolutional Lstm ◽  
Mosaic Images

<div>Advances in the design of multi-spectral cameras have</div><div>led to great interests in a wide range of applications, from</div><div>astronomy to autonomous driving. However, such cameras</div><div>inherently suffer from a trade-off between the spatial and</div><div>spectral resolution. In this paper, we propose to address</div><div>this limitation by introducing a novel method to carry out</div><div>super-resolution on raw mosaic images, multi-spectral or</div><div>RGB Bayer, captured by modern real-time single-shot mo-</div><div>saic sensors. To this end, we design a deep super-resolution</div><div>architecture that benefits from a sequential feature pyramid</div><div>along the depth of the network. This, in fact, is achieved</div><div>by utilizing a convolutional LSTM (ConvLSTM) to learn the</div><div>inter-dependencies between features at different receptive</div><div>fields. Additionally, by investigating the effect of different</div><div>attention mechanisms in our framework, we show that a</div><div>ConvLSTM inspired module is able to provide superior at-</div><div>tention in our context. Our extensive experiments and anal-</div><div>yses evidence that our approach yields significant super-</div><div>resolution quality, outperforming current state-of-the-art</div><div>mosaic super-resolution methods on both Bayer and multi-</div><div>spectral images. Additionally, to the best of our knowledge,</div><div>our method is the first specialized method to super-resolve</div><div>mosaic images, whether it be multi-spectral or Bayer.</div><div><br></div>

scholarly journals Introduction to redundancy rules: the continuous wavelet transform comes of age

2018 ◽  
Vol 376 (2126) ◽  
pp. 20170258 ◽  
Author(s):  
Paul S. Addison
Keyword(s):  
Wavelet Transform ◽  
Continuous Wavelet Transform ◽  
State Of The Art ◽  
Structural Characteristics ◽  
Continuous Wavelet ◽  
Theme Issue ◽  
Current State ◽  
Analysis Methods ◽  
Wide Range ◽  
New Form

Redundancy: it is a word heavy with connotations of lacking usefulness. I often hear that the rationale for not using the continuous wavelet transform (CWT)—even when it appears most appropriate for the problem at hand—is that it is ‘redundant’. Sometimes the conversation ends there, as if self-explanatory. However, in the context of the CWT, ‘redundant’ is not a pejorative term, it simply refers to a less compact form used to represent the information within the signal. The benefit of this new form—the CWT—is that it allows for intricate structural characteristics of the signal information to be made manifest within the transform space, where it can be more amenable to study: resolution over redundancy. Once the signal information is in CWT form, a range of powerful analysis methods can then be employed for its extraction, interpretation and/or manipulation. This theme issue is intended to provide the reader with an overview of the current state of the art of CWT analysis methods from across a wide range of numerate disciplines, including fluid dynamics, structural mechanics, geophysics, medicine, astronomy and finance. This article is part of the theme issue ‘Redundancy rules: the continuous wavelet transform comes of age’.

scholarly journals Climate-dependent propagation of precipitation uncertainty into the water cycle

2020 ◽  
Author(s):  
Ali Fallah ◽  
Sungmin O ◽  
Rene Orth
Keyword(s):  
Hydrological Model ◽  
Water Cycle ◽  
State Of The Art ◽  
Rain Gauge ◽  
Multiple Sources ◽  
Current State ◽  
Wide Range ◽  
The Impact ◽  
Conceptual Hydrological Model

Abstract. Precipitation is a crucial variable for hydro-meteorological applications. Unfortunately, rain gauge measurements are sparse and unevenly distributed, which substantially hampers the use of in-situ precipitation data in many regions of the world. The increasing availability of high-resolution gridded precipitation products presents a valuable alternative, especially over gauge-sparse regions. Nevertheless, uncertainties and corresponding differences across products can limit the applicability of these data. This study examines the usefulness of current state-of-the-art precipitation datasets in hydrological modelling. For this purpose, we force a conceptual hydrological model with multiple precipitation datasets in > 200 European catchments. We consider a wide range of precipitation products, which are generated via (1) interpolation of gauge measurements (E-OBS and GPCC V.2018), (2) combination of multiple sources (MSWEP V2) and (3) data assimilation into reanalysis models (ERA-Interim, ERA5, and CFSR). For each catchment, runoff and evapotranspiration simulations are obtained by forcing the model with the various precipitation products. Evaluation is done at the monthly time scale during the period of 1984–2007. We find that simulated runoff values are highly dependent on the accuracy of precipitation inputs, and thus show significant differences between the simulations. By contrast, simulated evapotranspiration is generally much less influenced. The results are further analysed with respect to different hydro-climatic regimes. We find that the impact of precipitation uncertainty on simulated runoff increases towards wetter regions, while the opposite is observed in the case of evapotranspiration. Finally, we perform an indirect performance evaluation of the precipitation datasets by comparing the runoff simulations with streamflow observations. Thereby, E-OBS yields the best agreement, while furthermore ERA5, GPCC V.2018 and MSWEP V2 show good performance. In summary, our findings highlight a climate-dependent propagation of precipitation uncertainty through the water cycle; while runoff is strongly impacted in comparatively wet regions such as Central Europe, there are increasing implications on evapotranspiration towards drier regions.

scholarly journals AI-driven deep CNN approach for multi-label pathology classification using chest X-Rays

2021 ◽  
Vol 7 ◽  
pp. e495
Author(s):  
Saleh Albahli ◽  
Hafiz Tayyab Rauf ◽  
Abdulelah Algosaibi ◽  
Valentina Emilia Balas
Keyword(s):  
Neural Networks ◽  
Data Augmentation ◽  
State Of The Art ◽  
Synthetic Data ◽  
X Rays ◽  
Deep Convolutional Neural Networks ◽  
Current State ◽  
Pathology Classification ◽  
Wide Range ◽  
Multi Class Classification

Artificial intelligence (AI) has played a significant role in image analysis and feature extraction, applied to detect and diagnose a wide range of chest-related diseases. Although several researchers have used current state-of-the-art approaches and have produced impressive chest-related clinical outcomes, specific techniques may not contribute many advantages if one type of disease is detected without the rest being identified. Those who tried to identify multiple chest-related diseases were ineffective due to insufficient data and the available data not being balanced. This research provides a significant contribution to the healthcare industry and the research community by proposing a synthetic data augmentation in three deep Convolutional Neural Networks (CNNs) architectures for the detection of 14 chest-related diseases. The employed models are DenseNet121, InceptionResNetV2, and ResNet152V2; after training and validation, an average ROC-AUC score of 0.80 was obtained competitive as compared to the previous models that were trained for multi-class classification to detect anomalies in x-ray images. This research illustrates how the proposed model practices state-of-the-art deep neural networks to classify 14 chest-related diseases with better accuracy.

scholarly journals Biomarkers of adverse drug reactions

2017 ◽  
Vol 243 (3) ◽  
pp. 291-299 ◽  
Author(s):  
Daniel F Carr ◽  
Munir Pirmohamed
Keyword(s):  
Pharmaceutical Industry ◽  
Adverse Drug Reactions ◽  
State Of The Art ◽  
Tissue Injury ◽  
Healthcare Providers ◽  
Drug Reactions ◽  
Circulating Biomarkers ◽  
Current State ◽  
Organ Systems ◽  
Wide Range

Adverse drug reactions can be caused by a wide range of therapeutics. Adverse drug reactions affect many bodily organ systems and vary widely in severity. Milder adverse drug reactions often resolve quickly following withdrawal of the casual drug or sometimes after dose reduction. Some adverse drug reactions are severe and lead to significant organ/tissue injury which can be fatal. Adverse drug reactions also represent a financial burden to both healthcare providers and the pharmaceutical industry. Thus, a number of stakeholders would benefit from development of new, robust biomarkers for the prediction, diagnosis, and prognostication of adverse drug reactions. There has been significant recent progress in identifying predictive genomic biomarkers with the potential to be used in clinical settings to reduce the burden of adverse drug reactions. These have included biomarkers that can be used to alter drug dose (for example, Thiopurine methyltransferase (TPMT) and azathioprine dose) and drug choice. The latter have in particular included human leukocyte antigen (HLA) biomarkers which identify susceptibility to immune-mediated injuries to major organs such as skin, liver, and bone marrow from a variety of drugs. This review covers both the current state of the art with regard to genomic adverse drug reaction biomarkers. We also review circulating biomarkers that have the potential to be used for both diagnosis and prognosis, and have the added advantage of providing mechanistic information. In the future, we will not be relying on single biomarkers (genomic/non-genomic), but on multiple biomarker panels, integrated through the application of different omics technologies, which will provide information on predisposition, early diagnosis, prognosis, and mechanisms. Impact statement • Genetic and circulating biomarkers present significant opportunities to personalize patient therapy to minimize the risk of adverse drug reactions. ADRs are a significant heath issue and represent a significant burden to patients, healthcare providers, and the pharmaceutical industry. • This review details the current state of the art in biomarkers of ADRs (both genetic and circulating). There is still significant variability in patient response which cannot be explained by current knowledge of genetic risk factors for ADRs; however, we discussed how specific advances in genomics have the potential to yield better and more predictive models. • Many current clinically utilized circulating biomarkers of tissue injury are valid biomarkers for a number of ADRs. However, they often give little insight into the specific cell or tissue subtype which may be affected. Emerging circulating biomarkers with potential to provide greater information on the etiology/pathophysiology of ADRs are described.

scholarly journals Tensile Testing of Soils: History, Equipment and Methodologies

2020 ◽  
Vol 6 (3) ◽  
pp. 591-601
Author(s):  
Ausamah Al Houri ◽  
Ahed Habib ◽  
Ahmed Elzokra ◽  
Maan Habib
Keyword(s):  
Tensile Strength ◽  
State Of The Art ◽  
Retaining Walls ◽  
Tensile Tests ◽  
Testing Methods ◽  
Embankment Dams ◽  
Current State ◽  
Wide Range ◽  
Indirect Tensile ◽  
And Behavior

Tensile strength of soil is indeed one of the important parameters to many civil engineering applications. It is related to wide range of cracks specially in places such as slops, embankment dams, retaining walls or landfills. Despite of the fact that tensile strength is usually presumed to be zero or negligible, its effect on the erosion and cracks development in soil is significant. Thus, to study the tensile strength and behavior of soil several techniques and devices were introduced. These testing methods are classified into direct and indirect ways depending on the loading conditions. The direct techniques including c-shaped mold and 8-shaped mold are in general complicated tests and require high accuracy as they are based on applying a uniaxial tension load directly to the specimen. On the other hand, the indirect tensile tests such as the Brazilian, flexure beam, double punch and hollow cylinder tests provide easy ways to assess the tensile strength of soil under controlled conditions. Although there are many studies in this topic the current state of the art lack of a detailed article that reviews these methodologies. Therefore, this paper is intended to summarize and compare available tests for investigating the tensile behavior of soils.

scholarly journals Low Resolution Information Also Matters: Learning Multi-Resolution Representations for Person Re-Identification

2021 ◽  
Author(s):  
Guoqing Zhang ◽  
Yuhao Chen ◽  
Weisi Lin ◽  
Arun Chandran ◽  
Xuan Jing
Keyword(s):  
Feature Extraction ◽  
High Resolution ◽  
Feature Fusion ◽  
State Of The Art ◽  
Super Resolution ◽  
Input Image ◽  
Low Resolution ◽  
Joint Learning ◽  
Novel Method ◽  
Valid Information

As a prevailing task in video surveillance and forensics field, person re-identification (re-ID) aims to match person images captured from non-overlapped cameras. In unconstrained scenarios, person images often suffer from the resolution mismatch problem, i.e., Cross-Resolution Person Re-ID. To overcome this problem, most existing methods restore low resolution (LR) images to high resolution (HR) by super-resolution (SR). However, they only focus on the HR feature extraction and ignore the valid information from original LR images. In this work, we explore the influence of resolutions on feature extraction and develop a novel method for cross-resolution person re-ID called Multi-Resolution Representations Joint Learning (MRJL). Our method consists of a Resolution Reconstruction Network (RRN) and a Dual Feature Fusion Network (DFFN). The RRN uses an input image to construct a HR version and a LR version with an encoder and two decoders, while the DFFN adopts a dual-branch structure to generate person representations from multi-resolution images. Comprehensive experiments on five benchmarks verify the superiority of the proposed MRJL over the relevent state-of-the-art methods.

scholarly journals Single Image Reconstruction using Novel Super Resolution Technique for Large Scaled Images

2021 ◽  
Author(s):  
Ramanath Datta ◽  
Sekhar Mandal ◽  
Saiyed Umer ◽  
Ahmad Ali AlZubi ◽  
Abdullah Alharbi ◽  
...  
Keyword(s):  
Image Reconstruction ◽  
Architectural Design ◽  
State Of The Art ◽  
Super Resolution ◽  
Electrical Machine ◽  
Single Image ◽  
Resolution Image ◽  
Working Principle ◽  
Novel Method ◽  
Homogeneous Regions

Abstract A fast and novel method for single-image reconstruction using super resolution (SR) technique has been proposed in this paper. The working principle of proposed technique has been divided into three components. In the first component, a low resolution image is divided into several homogeneous or non-homogeneous regions. This partition is based on the analysis of texture pattern within that region. Only the non-homogeneous regions undergo to the sparse representation for super resolution image reconstruction in the second component. The obtained reconstructed region from the second component undergoes to a statistical based prediction model to generate its more enhanced version in the third component. The remaining homogeneous regions are bicubic interpolated and reflected to the required high resolution image. The proposed technique is applied on some Large scaled Electrical, Machine and Civil architectural design images. The purpose of using these images is that these images are huge in size and processing such large images for any applications, is time consuming. The proposed SR technique results the better reconstructed SR image from its very lower version with low time complexity. The performance of the proposed system on the Electrical, Machine and Civil architectural design images is compared with the state-of-the-art methods and it is shown that the proposed system outperforms the other competing methods.

scholarly journals Enhancing Label Representations with Relational Inductive Bias Constraint for Fine-Grained Entity Typing

2021 ◽  
Author(s):  
Jinqing Li ◽  
Xiaojun Chen ◽  
Dakui Wang ◽  
Yuwei Li
Keyword(s):  
State Of The Art ◽  
Phase 1 ◽  
Phase 2 ◽  
Two Phase ◽  
Inductive Bias ◽  
Fine Grained ◽  
Wide Range ◽  
Dynamic Experiments ◽  
Novel Method ◽  
Public Datasets

Fine-Grained Entity Typing (FGET) is a task that aims at classifying an entity mention into a wide range of entity label types. Recent researches improve the task performance by imposing the label-relational inductive bias based on the hierarchy of labels or label co-occurrence graph. However, they usually overlook explicit interactions between instances and labels which may limit the capability of label representations. Therefore, we propose a novel method based on a two-phase graph network for the FGET task to enhance the label representations, via imposing the relational inductive biases of instance-to-label and label-to-label. In the phase 1, instance features will be introduced into label representations to make the label representations more representative. In the phase 2, interactions of labels will capture dependency relationships among them thus make label representations more smooth. During prediction, we introduce a pseudo-label generator for the construction of the two-phase graph. The input instances differ from batch to batch so that the label representations are dynamic. Experiments on three public datasets verify the effectiveness and stability of our proposed method and achieve state-of-the-art results on their testing sets.

scholarly journals Frame and Feature-Context Video Super-Resolution

2019 ◽  
Vol 33 ◽  
pp. 5597-5604
Author(s):  
Bo Yan ◽  
Chuming Lin ◽  
Weimin Tan
Keyword(s):  
Information Flow ◽  
State Of The Art ◽  
Super Resolution ◽  
Sliding Window ◽  
Visual Quality ◽  
Local Network ◽  
Context Information ◽  
High Quality ◽  
Current State ◽  
Inter Frame

For video super-resolution, current state-of-the-art approaches either process multiple low-resolution (LR) frames to produce each output high-resolution (HR) frame separately in a sliding window fashion or recurrently exploit the previously estimated HR frames to super-resolve the following frame. The main weaknesses of these approaches are: 1) separately generating each output frame may obtain high-quality HR estimates while resulting in unsatisfactory flickering artifacts, and 2) combining previously generated HR frames can produce temporally consistent results in the case of short information flow, but it will cause significant jitter and jagged artifacts because the previous super-resolving errors are constantly accumulated to the subsequent frames.In this paper, we propose a fully end-to-end trainable frame and feature-context video super-resolution (FFCVSR) network that consists of two key sub-networks: local network and context network, where the first one explicitly utilizes a sequence of consecutive LR frames to generate local feature and local SR frame, and the other combines the outputs of local network and the previously estimated HR frames and features to super-resolve the subsequent frame. Our approach takes full advantage of the inter-frame information from multiple LR frames and the context information from previously predicted HR frames, producing temporally consistent highquality results while maintaining real-time speed by directly reusing previous features and frames. Extensive evaluations and comparisons demonstrate that our approach produces state-of-the-art results on a standard benchmark dataset, with advantages in terms of accuracy, efficiency, and visual quality over the existing approaches.

Sign in / Sign up

Export Citation Format

Share Document