scholarly journals Small Multispectral UAV Sensor and Its Image Fusion Capability in Cultural Heritage Applications

Heritage ◽  
2020 ◽  
Vol 3 (4) ◽  
pp. 1046-1062
Author(s):  
Dimitris Kaimaris ◽  
Aristoteles Kandylas
Keyword(s):  
Image Fusion ◽  
Spatial Resolution ◽  
Archaeological Site ◽  
Digital Processing ◽  
Archaeological Sites ◽  
Technological Evolution ◽  
Multispectral Images ◽  
Fused Image ◽  
Spectral Fidelity ◽  
Digital Measurements

For many decades the multispectral images of the earth’s surface and its objects were taken from multispectral sensors placed on satellites. In recent years, the technological evolution produced similar sensors (much smaller in size and weight) which can be placed on Unmanned Aerial Vehicles (UAVs), thereby allowing the collection of higher spatial resolution multispectral images. In this paper, Parrot’s small Multispectral (MS) camera Sequoia+ is used, and its images are evaluated at two archaeological sites, on the Byzantine wall (ground application) of Thessaloniki city (Greece) and on a mosaic floor (aerial application) at the archaeological site of Dion (Greece). The camera receives RGB and MS images simultaneously, a fact which does not allow image fusion to be performed, as in the standard utilization procedure of Panchromatic (PAN) and MS image of satellite passive systems. In this direction, that is, utilizing the image fusion processes of satellite PAN and MS images, this paper demonstrates that with proper digital processing the images (RGB and MS) of small MS cameras can lead to a fused image with a high spatial resolution, which retains a large percentage of the spectral information of the original MS image. The high percentage of spectral fidelity of the fused images makes it possible to perform high-precision digital measurements in archaeological sites such as the accurate digital separation of the objects, area measurements and retrieval of information not so visible with common RGB sensors via the MS and RGB data of small MS sensors.

Mapping and Monitoring of the Land Use/Cover Changes in the Wider Area of ltanos, Crete, Using Very High Resolution EO Imagery With Specific Interest in Archaeological Sites

2019 ◽  
Author(s):  
Sawyer Reid stippa ◽  
George Petropoulos ◽  
Leonidas Toulios ◽  
Prashant K. Srivastava
Keyword(s):  
High Resolution ◽  
Spatial Resolution ◽  
Satellite Images ◽  
Archaeological Site ◽  
Digital Photography ◽  
Archaeological Sites ◽  
Large Area ◽  
High Resolution Imagery ◽  
Site Mapping ◽  
Rule Sets

Archaeological site mapping is important for both understanding the history as well as protecting them from excavation during the developmental activities. As archaeological sites generally spread over a large area, use of high spatial resolution remote sensing imagery is becoming increasingly applicable in the world. The main objective of this study was to map the land cover of the Itanos area of Crete and of its changes, with specific focus on the detection of the landscape’s archaeological features. Six satellite images were acquired from the Pleiades and WorldView-2 satellites over a period of 3 years. In addition, digital photography of two known archaeological sites was used for validation. An Object Based Image Analysis (OBIA) classification was subsequently developed using the five acquired satellite images. Two rule-sets were created, one using the standard four bands which both satellites have and another for the two WorldView-2 images their four extra bands included. Validation of the thematic maps produced from the classification scenarios confirmed a difference in accuracy amongst the five images. Comparing the results of a 4-band rule-set versus the 8-band showed a slight increase in classification accuracy using extra bands. The resultant classifications showed a good level of accuracy exceeding 70%. Yet, separating the archaeological sites from the open spaces with little or no vegetation proved challenging. This was mainly due to the high spectral similarity between rocks and the archaeological ruins. The satellite data spatial resolution allowed for the accuracy in defining larger archaeological sites, but still was a difficulty in distinguishing smaller areas of interest. The digital photography data provided a very good 3D representation for the archaeological sites, assisting as well in validating the satellite-derived classification maps. All in all, our study provided further evidence that use of high resolution imagery may allow for archaeological sites to be located, but only where they are of a suitable size archaeological features.

scholarly journals Optical SAR Images Fusion: Comparative Analysis of Resulting Images Data

2018 ◽  
Vol 215 ◽  
pp. 01002
Author(s):  
Yuhendra ◽  
Minarni
Keyword(s):  
Image Fusion ◽  
Spatial Resolution ◽  
Mean Squared Error ◽  
Statistical Parameter ◽  
Speckle Noise ◽  
Sar Images ◽  
Squared Error ◽  
Fused Image ◽  
Fusion Methods ◽  
High Pass

Image fusion is a useful tool for integrating low spatial resolution multispectral (MS) images with a high spatial resolution panchromatic (PAN) image, thus producing a high resolution multispectral image for better understanding of the observed earth surface. A main proposed the research were the effectiveness of different image fusion methods while filtering methods added to speckle suppression in synthetic aperture radar (SAR) images. The quality assessment of the filtering fused image implemented by statistical parameter namely mean, standard deviation, bias, universal index quality image (UIQI) and root mean squared error (RMSE). In order to test the robustness of the image quality, either speckle noise (Gamma map filter) is intentionally added to the fused image. When comparing and testing result, Gram Scmidth (GS) methods have shown better results for good colour reproduction, as compared with high pass filtering (HPF). And the other hands, GS, and wavelet intensity hue saturation (W-IHS) have shown the preserving good colour with original image for Landsat TM data.

scholarly journals ADVANCES IN HYPERSPECTRAL AND MULTISPECTRAL IMAGE FUSION AND SPECTRAL UNMIXING

2015 ◽  
Vol XL-3/W3 ◽  
pp. 451-458 ◽  
Author(s):  
C. Lanaras ◽  
E. Baltsavias ◽  
K. Schindler
Keyword(s):  
Image Fusion ◽  
Hyperspectral Image ◽  
Mathematical Optimization ◽  
Spectral Unmixing ◽  
Semantic Interpretation ◽  
Multispectral Images ◽  
Hyperspectral Unmixing ◽  
Environmental Mapping ◽  
Fused Image ◽  
Linear Spectral Unmixing

In this work, we jointly process high spectral and high geometric resolution images and exploit their synergies to (a) generate a fused image of high spectral and geometric resolution; and (b) improve (linear) spectral unmixing of hyperspectral endmembers at subpixel level w.r.t. the pixel size of the hyperspectral image. We assume that the two images are radiometrically corrected and geometrically co-registered. The scientific contributions of this work are (a) a simultaneous approach to image fusion and hyperspectral unmixing, (b) enforcing several physically plausible constraints during unmixing that are all well-known, but typically not used in combination, and (c) the use of efficient, state-of-the-art mathematical optimization tools to implement the processing. The results of our joint fusion and unmixing has the potential to enable more accurate and detailed semantic interpretation of objects and their properties in hyperspectral and multispectral images, with applications in environmental mapping, monitoring and change detection. In our experiments, the proposed method always improves the fusion compared to competing methods, reducing RMSE between 4% and 53%.

scholarly journals Fusion of Hyperspectral and Multispectral Images Based on a Centralized Non-local Sparsity Model of Abundance Maps

Tecnura ◽  
2020 ◽  
Vol 24 (66) ◽  
pp. 62-75
Author(s):  
Edwin Vargas ◽  
Kevin Arias ◽  
Fernando Rojas ◽  
Henry Arguello
Keyword(s):  
Image Fusion ◽  
Sparse Representation ◽  
Spatial Resolution ◽  
Real Data ◽  
Spectral Unmixing ◽  
Multispectral Images ◽  
Self Similarity ◽  
Diverse Range ◽  
Learned Dictionary ◽  
Non Local

Objective: Hyperspectral (HS) imaging systems are commonly used in a diverse range of applications that involve detection and classification tasks. However, the low spatial resolution of hyperspectral images may limit the performance of the involved tasks in such applications. In the last years, fusing the information of an HS image with high spatial resolution multispectral (MS) or panchromatic (PAN) images has been widely studied to enhance the spatial resolution. Image fusion has been formulated as an inverse problem whose solution is an HS image which assumed to be sparse in an analytic or learned dictionary. This work proposes a non-local centralized sparse representation model on a set of learned dictionaries in order to regularize the conventional fusion problem.Methodology: The dictionaries are learned from the estimated abundance data taking advantage of the depth correlation between abundance maps and the non-local self- similarity over the spatial domain. Then, conditionally on these dictionaries, the fusion problem is solved by an alternating iterative numerical algorithm.Results: Experimental results with real data show that the proposed method outperforms the state-of-the-art methods under different quantitative assessments.Conclusions: In this work, we propose a hyperspectral and multispectral image fusion method based on a non-local centralized sparse representation on abundance maps. This model allows us to include the non-local redundancy of abundance maps in the fusion problem using spectral unmixing and improve the performance of the sparsity-based fusion approaches.

scholarly journals ANALYSIS OF SPOT-6 DATA FUSION USING GRAM-SCHMIDT SPECTRAL SHARPENING ON RURAL AREAS

2014 ◽  
Vol 10 (2) ◽  
Author(s):  
Danang Surya Candra
Keyword(s):  
Data Fusion ◽  
Spatial Resolution ◽  
Rural Areas ◽  
Signal To Noise Ratio ◽  
Test Site ◽  
Multispectral Images ◽  
Fused Image ◽  
Pc Method ◽  
Better Than

Image fusion is a process to generate higher spatial resolution multispectral images by fusion of lower resolution multispectral images and higher resolution panchromatic images. It is used to generate not only visually appealing images but also provide detailed images to support applications in remote sensing field, including rural area. The aim of this study was to evaluate the performance of SPOT-6 data fusion using Gram-Schmidt Spectral Sharpening (GS) method on rural areas. GS method was compared with Principle Component Spectral Sharpening (PC) method to evaluate the reliability of GS method. In this study, the performance of GS was presented based on multispectral and panchromatic of SPOT-6 images. The spatial resolution of the multispectral (MS) image was enhanced by merging the high resolution Panchromatic (Pan) image in GS method. The fused image of GS and PC were assessed visually and statistically. Relative Mean Difference (RMD), Relative Variation Difference (RVD), and Peak Signal to Noise Ratio (PSNR) Index were used to assess the fused image statistically. The test sites of rural areas were devided into four main areas i.e., whole area, rice field area, forest area, and settlement. Based on the results, the visual quality of the fused image using GS method was better than using PC method. The color of the fused image using GS was better and more natural than using PC. In the statistical assessment, the RMD results of both methods were similar. In the RVD results, GS method was better then PC method especially in band 1 and band 3. GS method was better than PC method in PSNR result for each test site. It was observed that the Gram-Schmidt method provides the best performance for each band and test site. Thus, GS was a robust method for SPOT-6 data fusion especially on rural areas.

New texture-based pansharpening method using wavelet packet transform and PCA

2020 ◽  
Vol 18 (04) ◽  
pp. 2050025
Author(s):  
Asma Abdolahpoor ◽  
Peyman Kabiri
Keyword(s):  
High Resolution ◽  
Image Fusion ◽  
Spatial Resolution ◽  
Wavelet Packet ◽  
Principal Component ◽  
Wavelet Packet Transform ◽  
Multispectral Image ◽  
Multispectral Images ◽  
Low Resolution ◽  
Panchromatic Image

Image fusion is an important concept in remote sensing. Earth observation satellites provide both high-resolution panchromatic and low-resolution multispectral images. Pansharpening is aimed on fusion of a low-resolution multispectral image with a high-resolution panchromatic image. Because of this fusion, a multispectral image with high spatial and spectral resolution is generated. This paper reports a new method to improve spatial resolution of the final multispectral image. The reported work proposes an image fusion method using wavelet packet transform (WPT) and principal component analysis (PCA) methods based on the textures of the panchromatic image. Initially, adaptive PCA (APCA) is applied to both multispectral and panchromatic images. Consequently, WPT is used to decompose the first principal component of multispectral and panchromatic images. Using WPT, high frequency details of both panchromatic and multispectral images are extracted. In areas with similar texture, extracted spatial details from the panchromatic image are injected into the multispectral image. Experimental results show that the proposed method can provide promising results in fusing multispectral images with high-spatial resolution panchromatic image. Moreover, results show that the proposed method can successfully improve spectral features of the multispectral image.

The Archaeological Record

2017 ◽  
Author(s):  
Manjil Hazarika
Keyword(s):  
Archaeological Site ◽  
Northeast India ◽  
Site Formation ◽  
Archaeological Sites ◽  
Site Formation Processes ◽  
Formation Processes ◽  
Site Structure ◽  
Reserve Forest ◽  
Ethnographic Data ◽  
Ways Of Life

This chapter elaborates the data and results of the explorations conducted in the Garbhanga Reserve Forest. The area has been intensively surveyed for the location of potential archaeological sites and the collection of ethnographic data in order to draw direct historical analogies. An ‘area-approach’ study has been conducted in order to formulate a general model for archaeological site structure, locations, geomorphic situations, and site formation processes that can be used for archaeological study in the hilly landscape of Northeast India. Present-day agricultural implements have been analysed and compared with Neolithic implements in order to reconstruct ancient farming culture by way of undertaking systematic study of modern peasant ways of life in the study area. The ideological significance of stone artefacts as ‘thunderstone’ in Northeast India and among the Karbis has also been discussed.

scholarly journals Fast Multi-Focus Fusion Based on Deep Learning for Early-Stage Embryo Image Enhancement

Sensors ◽  
2021 ◽  
Vol 21 (3) ◽  
pp. 863
Author(s):  
Vidas Raudonis ◽  
Agne Paulauskaite-Taraseviciene ◽  
Kristina Sutiene
Keyword(s):  
Deep Learning ◽  
Image Fusion ◽  
Early Stage ◽  
Image Data ◽  
Cell Detection ◽  
Processing Times ◽  
Fused Image ◽  
Stage Embryo ◽  
Early Stage Embryo

Background: Cell detection and counting is of essential importance in evaluating the quality of early-stage embryo. Full automation of this process remains a challenging task due to different cell size, shape, the presence of incomplete cell boundaries, partially or fully overlapping cells. Moreover, the algorithm to be developed should process a large number of image data of different quality in a reasonable amount of time. Methods: Multi-focus image fusion approach based on deep learning U-Net architecture is proposed in the paper, which allows reducing the amount of data up to 7 times without losing spectral information required for embryo enhancement in the microscopic image. Results: The experiment includes the visual and quantitative analysis by estimating the image similarity metrics and processing times, which is compared to the results achieved by two wellknown techniques—Inverse Laplacian Pyramid Transform and Enhanced Correlation Coefficient Maximization. Conclusion: Comparatively, the image fusion time is substantially improved for different image resolutions, whilst ensuring the high quality of the fused image.

Effects of spatial resolution ratio in image fusion

2008 ◽  
Vol 29 (7) ◽  
pp. 2157-2167 ◽  
Author(s):  
Y. Ling ◽  
M. Ehlers ◽  
E. L. Usery ◽  
M. Madden
Keyword(s):  
Image Fusion ◽  
Spatial Resolution

scholarly journals Multitemporal–Multispectral UAS Surveys for Archaeological Research: The Case Study of San Vincenzo Al Volturno (Molise, Italy)

2021 ◽  
Vol 13 (14) ◽  
pp. 2719
Author(s):  
Nicodemo Abate ◽  
Alessia Frisetti ◽  
Federico Marazzi ◽  
Nicola Masini ◽  
Rosa Lasaponara
Keyword(s):  
Middle Ages ◽  
Principal Component ◽  
Archaeological Site ◽  
Archaeological Sites ◽  
Medieval Art ◽  
Archaeological Data ◽  
History Of ◽  
Close Range ◽  
Low Altitude

Unmanned aerial vehicles are currently the most used solution for cultural heritage in the field of close range and low altitude acquisitions. This work shows data acquired by multitemporal and multispectral aerial surveys in the archaeological site of San Vincenzo al Volturno (Molise, Italy). The site is one of the most important medieval archaeological sites in the world. It is a monastic settlement that was particularly rich during the early Middle Ages, and is famous for its two full-frescoed crypts which represent a milestone in the history of medieval art. Thanks to the use of multispectral aerial photography at different times of the year, an area not accessible to archaeological excavation has been investigated. To avoid redundancy of information and reduce the number of data to be analysed, a method based on spectral and radiometric enhancement techniques combined with a selective principal component analysis was used for the identification of useful information. The combination of already published archaeological data and new remote sensing discoveries, has allowed to better define the situation of the abbey during the building phases of the 8th/9th century and 11th century, confirming and adding new data to the assumptions made by archaeologists.

Sign in / Sign up

Export Citation Format

Share Document