scholarly journals A New Volumetric Fusion Strategy with Adaptive Weight Field for RGB-D Reconstruction

Sensors ◽  
2020 ◽  
Vol 20 (15) ◽  
pp. 4330 ◽  
Author(s):  
Xinqi Liu ◽  
Jituo Li ◽  
Guodong Lu

High-quality 3D reconstruction results are very important in many application fields. However, current texture generation methods based on point sampling and fusion often produce blur. To solve this problem, we propose a new volumetric fusion strategy which can be embedded in the current online and offline reconstruction framework as a basic module to achieve excellent geometry and texture effects. The improvement comes from two aspects. Firstly, we establish an adaptive weight field to evaluate and adjust the reliability of data from RGB-D images by using a probabilistic and heuristic method. By using this adaptive weight field to guide the voxel fusion process, we can effectively preserve the local texture structure of the mesh, avoid wrong texture problems and suppress the influence of outlier noise on the geometric surface. Secondly, we use a new texture fusion strategy that combines replacement, integration, and fixedness operations to fuse and update voxel texture to reduce blur. Experimental results demonstrate that compared with the classical KinectFusion, our approach can significantly improve the accuracy in geometry and texture clarity, and can achieve equivalent texture reconstruction effects in real-time as the offline reconstruction methods such as intrinsic3d, even better in relief scenes.

2020 ◽  
Vol 10 (11) ◽  
pp. 3857
Author(s):  
Fangjia Yang ◽  
Shaoping Xu ◽  
Chongxi Li

Image denoising, a fundamental step in image processing, has been widely studied for several decades. Denoising methods can be classified as internal or external depending on whether they exploit the internal prior or the external noisy-clean image priors to reconstruct a latent image. Typically, these two kinds of methods have their respective merits and demerits. Using a single denoising model to improve existing methods remains a challenge. In this paper, we propose a method for boosting the denoising effect via the image fusion strategy. This study aims to boost the performance of two typical denoising methods, the nonlocally centralized sparse representation (NCSR) and residual learning of deep CNN (DnCNN). These two methods have complementary strengths and can be chosen to represent internal and external denoising methods, respectively. The boosting process is formulated as an adaptive weight-based image fusion problem by preserving the details for the initial denoised images output by the NCSR and the DnCNN. Specifically, we design two kinds of weights to adaptively reflect the influence of the pixel intensity changes and the global gradient of the initial denoised images. A linear combination of these two kinds of weights determines the final weight. The initial denoised images are integrated into the fusion framework to achieve our denoising results. Extensive experiments show that the proposed method significantly outperforms the NCSR and the DnCNN both quantitatively and visually when they are considered as individual methods; similarly, it outperforms several other state-of-the-art denoising methods.


Author(s):  
P.J. Lea ◽  
M.J. Hollenberg

Our current understanding of mitochondrial ultrastructure has been derived primarily from thin sections using transmission electron microscopy (TEM). This information has been extrapolated into three dimensions by artist's impressions (1) or serial sectioning techniques in combination with computer processing (2). The resolution of serial reconstruction methods is limited by section thickness whereas artist's impressions have obvious disadvantages.In contrast, the new techniques of HRSEM used in this study (3) offer the opportunity to view simultaneously both the internal and external structure of mitochondria directly in three dimensions and in detail.The tridimensional ultrastructure of mitochondria from rat hepatocytes, retinal (retinal pigment epithelium), renal (proximal convoluted tubule) and adrenal cortex cells were studied by HRSEM. The specimens were prepared by aldehyde-osmium fixation in combination with freeze cleavage followed by partial extraction of cytosol with a weak solution of osmium tetroxide (4). The specimens were examined with a Hitachi S-570 scanning electron microscope, resolution better than 30 nm, where the secondary electron detector is located in the column directly above the specimen inserted within the objective lens.


Author(s):  
Kent McDonald ◽  
David Mastronarde ◽  
Rubai Ding ◽  
Eileen O'Toole ◽  
J. Richard McIntosh

Mammalian spindles are generally large and may contain over a thousand microtubules (MTs). For this reason they are difficult to reconstruct in three dimensions and many researchers have chosen to study the smaller and simpler spindles of lower eukaryotes. Nevertheless, the mammalian spindle is used for many experimental studies and it would be useful to know its detailed structure.We have been using serial cross sections and computer reconstruction methods to analyze MT distributions in mitotic spindles of PtK cells, a mammalian tissue culture line. Images from EM negatives are digtized on a light box by a Dage MTI video camera containing a black and white Saticon tube. The signal is digitized by a Parallax 1280 graphics device in a MicroVax III computer. Microtubules are digitized at a magnification such that each is 10-12 pixels in diameter.


Author(s):  
Adriana Verschoor ◽  
Ronald Milligan ◽  
Suman Srivastava ◽  
Joachim Frank

We have studied the eukaryotic ribosome from two vertebrate species (rabbit reticulocyte and chick embryo ribosomes) in several different electron microscopic preparations (Fig. 1a-d), and we have applied image processing methods to two of the types of images. Reticulocyte ribosomes were examined in both negative stain (0.5% uranyl acetate, in a double-carbon preparation) and frozen hydrated preparation as single-particle specimens. In addition, chick embryo ribosomes in tetrameric and crystalline assemblies in frozen hydrated preparation have been examined. 2D averaging, multivariate statistical analysis, and classification methods have been applied to the negatively stained single-particle micrographs and the frozen hydrated tetramer micrographs to obtain statistically well defined projection images of the ribosome (Fig. 2a,c). 3D reconstruction methods, the random conical reconstruction scheme and weighted back projection, were applied to the negative-stain data, and several closely related reconstructions were obtained. The principal 3D reconstruction (Fig. 2b), which has a resolution of 3.7 nm according to the differential phase residual criterion, can be compared to the images of individual ribosomes in a 2D tetramer average (Fig. 2c) at a similar resolution, and a good agreement of the general morphology and of many of the characteristic features is seen.Both data sets show the ribosome in roughly the same ’view’ or orientation, with respect to the adsorptive surface in the electron microscopic preparation, as judged by the agreement in both the projected form and the distribution of characteristic density features. The negative-stain reconstruction reveals details of the ribosome morphology; the 2D frozen-hydrated average provides projection information on the native mass-density distribution within the structure. The 40S subunit appears to have an elongate core of higher density, while the 60S subunit shows a more complex pattern of dense features, comprising a rather globular core, locally extending close to the particle surface.


Author(s):  
Jovan Vukovié

Conventional electron microscope TEM -100 (Made by “ELECTRON”, Sumy, USSR; Fig. 1) was presented at the XI Int. Congress on Electron Microscopy (Kyoto) by I.S. Lyalko et al. (1,2). The purpose of the microscope constructors were to design a small-sized general conventional TEM for various application fields. The microscope have mini lenses, which winding is placed in closed casing and soaked in working liquid (low boiling temperature) but upper part of the casing being water cooled.In this communication we gave our first experience and impression as a customer, beginning from the montage, the instruction and the testing of the microscope to our application in the field of biological specimens. Just after montage of the microscope on the second floor, the test of the point resolution power was performed by Ir specimen. It was achieved 0.5 nm (Fig. 2 and 3) on the roll film (ORWO 22 DIN) with 300 OOOx magnification and anticontamination device. The ultimate vacuum (about 10exp-6 mm Hg, ion discharge pump) also achieved using large trap cooled by liquid nitrogen.


2017 ◽  
Vol 10 (5) ◽  
pp. 371
Author(s):  
Arakil Chentoufi ◽  
Abdelhakim El Fatmi ◽  
Molay Ali Bekri ◽  
Said Benhlima ◽  
Mohamed Sabbane

2020 ◽  
Vol 10 (3) ◽  
pp. 190-197
Author(s):  
A. B. Baichorov ◽  
A. O. Rasulov

The aim of the study was to compare functional results prior to and following neoadjuvant chemoradiation therapy.Materials and methods. An analysis of the functional results of a prospective clinical study was carried out. The study included 90 patients who underwent low anterior rectal resection for cancer of the lower or middle ampullar rectum with T1-4aN0-2M0 using various reconstruction methods.Results and discussion. Group A included 22 patients with J-shaped reservoirs; group B — 30 patients with side-to-end anastomoses; group C — 38 patients with end-to-end anastomoses. Out of the total study group (n = 90), 43 patients underwent neoadjuvant chemoradiotherapy vs. 47 patients without any preoperative treatment. No statistically significant difference was observed in the frequency of applied reconstructive techniques (р = 0.725) and the incidence of postoperative complications (p = 0.103) in the groups with and without neoadjuvant chemoradiotherapy. The baseline scores of the Wexner scale and the results of anorectal manometry in the comparison groups were comparable (p > 0.05). However, upon completion of neoadjuvant chemoradiotherapy and during the period from the moment of surgery up to 12 months after the closure of preventive intestinal stomas, the functional results were less satisfactory in the group of patients having received neoadjuvant chemoradiotherapy (n = 43) with regard to the comparison group (n =  47). Nevertheless, a statistically significant difference in the results was observed from the end of neoadjuvant chemoradiotherapy up to 3 months after closure of the stoma (p <0.05).Conclusions. Neoadjuvant chemoradiation therapy has a negative effect on the function of the anal sphincter, thus requiring concomitant therapy and physiotherapy both at the stages of neoadjuvant chemoradiotherapy and at long intervals after the main surgical stage. 


Sign in / Sign up

Export Citation Format

Share Document