Method for Enhancing High-Resolution Image Inpainting with Two-Stage Approach

2021 ◽  
Vol 47 (3) ◽  
pp. 201-206
Author(s):  
A. Moskalenko ◽  
M. Erofeev ◽  
D. Vatolin
Keyword(s):  
High Resolution ◽  
Image Inpainting ◽  
Two Stage ◽  
Resolution Image ◽  
High Resolution Image

scholarly journals High-Resolution Image Inpainting Based on Multi-Scale Neural Network

Electronics ◽  
2019 ◽  
Vol 8 (11) ◽  
pp. 1370 ◽  
Author(s):  
Tingzhu Sun ◽  
Weidong Fang ◽  
Wei Chen ◽  
Yanxin Yao ◽  
Fangming Bi ◽  
...  
Keyword(s):  
Neural Network ◽  
High Resolution ◽  
Pedestrian Detection ◽  
Image Inpainting ◽  
Resolution Image ◽  
Multi Scale ◽  
High Resolution Image ◽  
Adversarial Network ◽  
Generation Network ◽  
High Resolution Images

Although image inpainting based on the generated adversarial network (GAN) has made great breakthroughs in accuracy and speed in recent years, they can only process low-resolution images because of memory limitations and difficulty in training. For high-resolution images, the inpainted regions become blurred and the unpleasant boundaries become visible. Based on the current advanced image generation network, we proposed a novel high-resolution image inpainting method based on multi-scale neural network. This method is a two-stage network including content reconstruction and texture detail restoration. After holding the visually believable fuzzy texture, we further restore the finer details to produce a smoother, clearer, and more coherent inpainting result. Then we propose a special application scene of image inpainting, that is, to delete the redundant pedestrians in the image and ensure the reality of background restoration. It involves pedestrian detection, identifying redundant pedestrians and filling in them with the seemingly correct content. To improve the accuracy of image inpainting in the application scene, we proposed a new mask dataset, which collected the characters in COCO dataset as a mask. Finally, we evaluated our method on COCO and VOC dataset. the experimental results show that our method can produce clearer and more coherent inpainting results, especially for high-resolution images, and the proposed mask dataset can produce better inpainting results in the special application scene.

scholarly journals High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsampling

2020 ◽  
pp. 1-17 ◽  
Author(s):  
Yu Zeng ◽  
Zhe Lin ◽  
Jimei Yang ◽  
Jianming Zhang ◽  
Eli Shechtman ◽  
...  
Keyword(s):  
High Resolution ◽  
Image Inpainting ◽  
Resolution Image ◽  
High Resolution Image

scholarly journals Deep Two-Stage High-Resolution Image Inpainting

2020 ◽  
pp. short18-1-short18-9
Author(s):  
Andrey Moskalenko ◽  
Mikhail Erofeev ◽  
Dmitriy Vatolin
Keyword(s):  
Image Processing ◽  
High Resolution ◽  
Image Inpainting ◽  
Original Image ◽  
Two Stage ◽  
Arbitrary Size ◽  
Resolution Image ◽  
High Resolution Image

In recent years, the field of image inpainting has developed rapidly, learning-based approaches show impressive results in the task of filling missing parts in an image. But most deep methods are strongly tied to the resolution of the images on which they were trained. A slight resolution increase leads to serious artifacts and unsatisfactory filling quality. These methods are therefore unsuitable for interactive image processing. In this article, we propose a method that solves the problem of inpainting arbitrary-size images. We also describe a way to better restore texture fragments in the filled area. For this, we propose to use information from neighboring pixels by shifting the original image in four directions. Moreover, this approach can work with existing inpainting models, making them almost resolution-independent without the need for retraining. We also created a GIMP plugin that implements our technique. The plugin, code, and model weights are available at https://github.com/a-mos/High Resolution Image Inpainting.

scholarly journals SR-Inpaint: A General Deep Learning Framework for High Resolution Image Inpainting

Algorithms ◽  
2021 ◽  
Vol 14 (8) ◽  
pp. 236
Author(s):  
Haoran Xu ◽  
Xinya Li ◽  
Kaiyi Zhang ◽  
Yanbai He ◽  
Haoran Fan ◽  
...  
Keyword(s):  
Deep Learning ◽  
High Resolution ◽  
High Frequency ◽  
Image Inpainting ◽  
Super Resolution ◽  
Low Resolution ◽  
Resolution Image ◽  
Learning Framework ◽  
High Resolution Image ◽  
High Resolution Images

Recently, deep learning has enabled a huge leap forward in image inpainting. However, due to the memory and computational limitation, most existing methods are able to handle only low-resolution inputs, typically less than 1 K. With the improvement of Internet transmission capacity and mobile device cameras, the resolution of image and video sources available to users via the cloud or locally is increasing. For high-resolution images, the common inpainting methods simply upsample the inpainted result of the shrinked image to yield a blurry result. In recent years, there is an urgent need to reconstruct the missing high-frequency information in high-resolution images and generate sharp texture details. Hence, we propose a general deep learning framework for high-resolution image inpainting, which first hallucinates a semantically continuous blurred result using low-resolution inpainting and suppresses computational overhead. Then the sharp high-frequency details with original resolution are reconstructed using super-resolution refinement. Experimentally, our method achieves inspiring inpainting quality on 2K and 4K resolution images, ahead of the state-of-the-art high-resolution inpainting technique. This framework is expected to be popularized for high-resolution image editing tasks on personal computers and mobile devices in the future.

Radiation Damage, Contrast and Statistics in High Resolution Biological Electron Microscopy

1970 ◽  
Vol 28 ◽  
pp. 260-261
Author(s):  
Robert M. Glaeser
Keyword(s):  
High Resolution ◽  
Particle Flux ◽  
Unit Area ◽  
Signal To Noise ◽  
Resolution Image ◽  
High Resolution Image ◽  
Pass Through ◽  
Counting Statistics ◽  
The Relationship ◽  
Picture Element

It is well known that a large flux of electrons must pass through a specimen in order to obtain a high resolution image while a smaller particle flux is satisfactory for a low resolution image. The minimum particle flux that is required depends upon the contrast in the image and the signal-to-noise (S/N) ratio at which the data are considered acceptable. For a given S/N associated with statistical fluxtuations, the relationship between contrast and “counting statistics” is s131_eqn1, where C = contrast; r2 is the area of a picture element corresponding to the resolution, r; N is the number of electrons incident per unit area of the specimen; f is the fraction of electrons that contribute to formation of the image, relative to the total number of electrons incident upon the object.

New method for tree stands parameters determination using high resolution images done by unmanned aerial vehicle

2016 ◽  
Author(s):  
А.С. Алексеев ◽  
А.А. Никифоров ◽  
А.А. Михайлова ◽  
М.Р. Вагизов
Keyword(s):  
High Resolution ◽  
Unmanned Aerial Vehicle ◽  
New Method ◽  
Growth And Yield ◽  
Special Treatment ◽  
Resolution Image ◽  
Growing Stock ◽  
High Resolution Image ◽  
Aerial Vehicle ◽  
Area Unit

В связи со старением информационных материалов о состоянии лесов существует потребность в разработке новых методов таксации древостоев, основанных на применении последних научно-технических достижений в области теории структуры и продуктивности древостоев, дистанционных методов изучения лесов, информационных и ГИС технологий. В статье приведены результаты разработки и проверки нового метода определения таксационных характеристик сомкнутых насаждений на основе правила 3/2 и подобных ему правил Хильми и Рейнеке, с одной стороны, и определения числа деревьев на единице площади по снимку сверх высокого разрешения, полученного с помощью БПЛА, с другой. С теоретической точки зрения эта зависимости величин запаса, средней высоты и среднего диаметра от числа стволов на единице площади относятся к классу аллометрических связей, очень часто встречающихся при количественном описании соотношений частей биологических систем разных уровней иерархии, от организмов до экосистем. Параметры аллометрических зависимостей запаса, средних высоты и диаметра от числа стволов на единице площади были определены для основных лесообразующих пород по данным таблиц хода роста нормальных (полных) древостоев с теоретическим показателем степени и затем использованы для расчетов. Число деревьев на единице площади определялось по снимку с разрешением 7,13 см/пиксель, полученному с помощью 4-роторной платформы. Обработка материалов аэрофотосъемки была выполнена в специализированной фотограмметрической системе Agisoft Photoscan. В результате были получены ортофотоплан и цифровая модель поверхности крон деревьев на изучаемую территорию с определением их высот. Для автоматизированной обработки полученных изображений с целью получения значений числа деревьев на единицу площади был создан специализированный скрипт на языке Java. Погрешности определения таксационных характеристик древостоев предлагаемым методом не выше установленных действующими нормативными материалами. Every time there is a demand for new innovative methods of forest resources estimation based on last achievements in theoretical science, remote sensing methods, information and GIS-technologies. In the paper are presented a new method and the results of its application to forest stands growing stock, mean height and diameter determination. The method is based on rule 3/2 and similar Reineke and Hilmy rules, on one hand and high resolution image made by unmanned aerial vehicle, which used for determination of number of trees per area unit, on other. The above rules are well known in quantitative biology as an allometric and widely used for description of different kind of relations in biological systems of various scale: from organisms to ecosystems. Parameters of above allometric relationships between growing stock, mean height and diameter and stems density per area unit was determine on the base of full stock growth and yield tables for main tree species and after used for experimental calculations. The number of trees per area unit was determined after special treatment of high resolution image made by unmanned flying machine. The growing stock, mean height and diameter determined by suggested method was compared with the data of regular forest inventory. Comparison gives positive result and method may be recommended for further development.

Sign in / Sign up

Export Citation Format

Share Document