A comparison between stereophotogrammetry and smartphone structured light technology for three-dimensional face scanning

ABSTRACT Objectives To compare three-dimensional facial scans obtained by stereophotogrammetry with two different applications for smartphone supporting the TrueDepth system, a structured light technology. Materials and Methods Facial scans of 40 different subjects were acquired with three different systems. The 3dMDtrio Stereophotogrammetry System (3dMD, Atlanta, Ga) was compared with a smartphone (iPhone Xs; Apple, Cupertino, Calif) equipped with the Bellus3D Face Application (version 1.6.11; Bellus3D Inc, Campbell, Calif) or Capture (version 1.2.5; Standard Cyborg Inc, San Francisco, Calif). Times of image acquisition and elaboration were recorded. The surface-to-surface deviation and the distance between 18 landmarks from 3dMD reference images to those acquired with Bellus3D or Capture were measured. Results Capturing and processing times with the smartphone applications were considerably longer than with the 3dMD system. The surface-to-surface deviation analysis between the Bellus3D and 3dMD showed an overlap percentage of 80.01% ± 5.92% and 56.62% ± 7.65% within the ranges of 1 mm and 0.5 mm discrepancy, respectively. Images from Capture showed an overlap percentage of 81.40% ± 9.59% and 56.45% ± 11.62% within the ranges of 1 mm and 0.5 mm, respectively. Conclusions The face image acquisition with the 3dMD device is fast and accurate, but bulky and expensive. The new smartphone applications combined with the TrueDepth sensors show promising results. They need more accuracy from the operator and more compliance from the patient because of the increased acquisition time. Their greatest advantages are related to cost and portability.

Virtual Bronchoscopy-Guided Transbronchial Biopsy Simulation Using a Head-Mounted Display: A New Style of Flexible Bronchoscopy

Background/need. The increases in reference images and information during bronchoscopy using virtual bronchoscopic navigation (VBN) and fluoroscopy has potentially created the need for support using a head-mounted display (HMD) because bronchoscopists feel difficulty to see displays that are at a distance from them and turn their head and body in various directions. Methodology and device description. The binocular see-through Moverio BT-35E Smart Glasses can be connected via a high-definition multimedia interface and have a 720p high-definition display. We developed a system that converts fluoroscopic (live and reference), VBN, and bronchoscopic image signals through a converter and references them using the Moverio BT-35E. Preliminary results. We performed a virtual bronchoscopy-guided transbronchial biopsy simulation using the system. Four experienced pulmonologists performed a simulated bronchoscopy of 5 cases each with the Moverio BT-35E glasses, using bronchoscopy training model. For all procedures, the bronchoscope was advanced successfully into the target bronchus according to the VBN image. None of the operators reported eye or body fatigue during or after the procedure. Current status. This small-scale simulation study suggests the feasibility of using a HMD during bronchoscopy. For clinical use, it is necessary to evaluate the safety and usefulness of the system in larger clinical trials in the future.

The image description reduction in the set of descriptors on informativeness metric criteria base

The subject of the research is the methods of image classification on a set of key point descriptors in computer vision systems. The goal is to improve the performance of structural classification methods by introducing indexed hash structures on the set of the dataset reference images descriptors and a consistent chain combination of several stages of data analysis in the classification process. Applied methods: BRISK detector and descriptors, data hashing tools, search methods in large data arrays, metric models for the vector relevance estimation, software modeling. The obtained results: developed an effective method of image classification based on the introduction of high-speed search using indexed hash structures, that speeds up the calculation dozens of times; the gain in computing time increases with an increase of the number of reference images and descriptors in descriptions; the peculiarity of the classifier is that not an exact search is performed, but taking into account the permissible deviation of data from the reference; experimentally verified the effectiveness of the classification, which indicates the efficiency and effectiveness of the proposed method. The practical significance of the work is the construction of classification models in the transformed space of the hash data representation, the efficiency confirmation of the proposed classifiers modifications on image examples, development of applied software models implementing the proposed classification methods in computer vision systems.

A Supplementary Module to Improve Accuracy of the Quality Assessment Band in Landsat Cloud Images

Cloud contamination is a serious obstacle for the application of Landsat data. To popularize the applications of Landsat data, each Landsat image includes the corresponding Quality Assessment (QA) band, in which cloud and cloud shadow pixels have been flagged. However, previous studies suggested that Landsat QA band still needs to be modified to fulfill the requirement of Landsat data applications. In this study, we developed a Supplementary Module to improve the original QA band (called QA_SM). On one hand, QA_SM extracts spectral and geometrical features in the target Landsat cloud image from the original QA band. On the other, QA_SM incorporates the temporal change characteristics of clouds and cloud shadows between the target and reference images. We tested the new method at four local sites with different land covers and the Landsat-8 cloud cover validation dataset (“L8_Biome”). The experimental results show that QA_SM performs better than the original QA band and the multi-temporal method ATSA (Automatic Time-Series Analyses). QA_SM decreases omission errors of clouds and shadows in the original QA band effectively but meanwhile does not increase commission errors. Besides, the better performance of QA_SM is less affected by the selections of reference images because QA_SM considers the temporal change of land surface reflectance that is not caused by cloud contamination. By further designing a quantitative assessment experiment, we found that the QA band generated by QA_SM improves cloud-removal performance on Landsat cloud images, suggesting the benefits of the new method to advance the applications of Landsat data.

METHODOLOGY FOR FORMING A DATABASE OF REFERENCE IMAGES OF BONE MARROW CELLS FOR THE AUTOMATED DIAGNOSIS OF ACUTE LEUKEMIA IN ONCOHEMATOLOGY

В статье представлено описание факторов, влияющих на качество формирования базы эталонных изображений клеток костного мозга для диагностики острых лейкозов с применением методов компьютерной микроскопии. Отмечена важность контроля качества подготовки препаратов и микроскопа для применения в автоматизированных системах анализа изображений. Рассмотрены особенности регистрации цифровых микроскопических изображений клеток костного мозга в системах компьютерной микроскопии. Исследовано влияние фокусировки оптической системы микроскопа и уровня освещения препарата на формирование цифровых изображений клеток костного мозга. Установлены требования к условиям регистрации цифровых изображений, используемых в автоматизированных системах микроскопического анализа препаратов костного мозга. Предложена концептуальная модель базы эталонных изображений костного мозга, являющаяся основой для разработки инструментов эффективного распознавания клеток костного мозга в системах компьютерной микроскопии. Следование указанным требованиям к регистрации изображений призвано обеспечить надлежащее качество эталонной базы, что имеет непосредственной влияние на повышение точности и достоверности медицинской диагностики с применением методов компьютерной микроскопии. Результаты работы могут быть использованы в системах поддержки принятия врачебных решений при диагностике острых лейкозов The article describes the factors affecting the quality of the formation of a database of reference images of bone marrow cells for the diagnosis of acute leukemia using computer microscopy methods. The importance of quality control of specimen and microscope preparation for use in automated image analysis systems is noted. The features of registration of digital microscopic images of bone marrow cells in computer microscopy systems are considered. The effect of focusing of the optical system of the microscope and the level of illumination of the specimen on the formation of digital images of bone marrow cells is investigated. The requirements for the conditions of registration of digital images used in automated systems of microscopic analysis of bone marrow preparations have been established. A conceptual model of the base of reference images of bone marrow is proposed. It is the basis for the development of tools for effective recognition of bone marrow cells in computer microscopy systems. Following the specified requirements for image registration is designed to ensure the proper quality of the reference base of images, which has a direct impact on improving the accuracy and reliability of medical diagnostics using computer microscopy. The results of the work can be used in medical decision support systems for the diagnosis of acute leukemia

Wine quality under integrated, organic and biodynamic management using image-forming methods and sensory analysis

Background and aims The image-forming methods copper chloride crystallization, capillary dynamolysis and circular chromatography are presented as an instrument for assessing wine quality. Wine quality of samples from a long-term field trial comparing integrated, organic and biodynamic management were investigated by using image-forming methods and sensory analysis. Methods and results Concerning the image-forming methods copper chloride crystallization, capillary dynamolysis and circular chromatography, the images of encoded samples were (i) grouped into pairs with similar image features; (ii) characterized based on reference images (e. g. high–low resistance to degradation); (iii) ranked (according to the characterization), and (iv) assigned to the different production methods (classified). Wine samples from organic and biodynamic management needed less wine per sample for a similar expression of structural characteristics than wine samples from integrated cultivation. Organic and biodynamic samples also show structures that indicate less degeneration than integrated samples. Due to these properties, nine coded wine samples from 2010 could be (i) grouped, (ii) characterized, (iii) ranked and (iv) classified without errors, i.e., assigned to the cultivation methods of integrated, organic and biodynamic agriculture. In sensory analysis, the wine derived from biodynamic management had the highest aroma intensity. In the other parameters the differences were not significant. Conclusion Analysis with the image-forming methods copper chloride crystallization, capillary dynamolysis and circular chromatography complements sensory analysis for a more complete description of the characteristic properties of wines originating from different management systems. Significance of the study If further studies confirm these results, the image-forming methods copper chloride crystallization, capillary dynamolysis and circular chromatography may be developed as a complementary tool to sensory and chemical analysis in assessing wine quality. Graphic abstract

A technical review of no-reference image quality assessment algorithms for contrast distorted images

Automatic image quality assessment similar to human vision perception is an essential process for real-time image processing applications to perform perceptual image assessments for effectively achieving their goals. As no-reference image quality assessment (NR-IQA) schemes perform perceptual assessments of images without any information about their original version, these algorithms suit real-time computer vision techniques because of the non-availability of reference images. Contrast and colorfulness play important roles in determining the quality of color images. By combining many IQA metrics, a number of combined metrics had been devised. This study provides an insight into major NR-IQA methods and their effectiveness in assessing contrast, colorfulness, and overall quality of contrast-degraded images with technical analysis. The effectiveness of top-ranking NR-IQA methods is experimentally assessed with benchmark assessment methods on images from benchmarked databases. The study provides insight into open research challenges in the area of NR-IQA for developing new promising methods by clearly demarcating the difficulties of top-ranking NR-IQA methods.

Digital AI in Hematology - Integration of the Scopio Labs x100 Scanner with Newly Implemented AI Capabilities into Routine Clinical Workflow

BACKGROUND Digital pathology and artificial intelligence (AI) are areas of growing interest in pathology. A number of institutes have already integrated digital imaging into routine workflow, relying on AI algorithms for the detection of various cancers and mitotic activity quantification. Despite the use of whole slide imaging (WSI) for tissue evaluation, the field of hematology has lagged behind. While many hospitals rely on limited technologies for automated peripheral blood evaluation (e.g. CellavisionTM), the Scopio LabsTM X100 digital scanner provides high resolution oil-immersion level dynamic images of large scanned areas (https://scopiolabs.com/hematology/). With recent FDA-clearance and newly implemented AI capabilities, the Scopio Labs scanner allows for clear and accurate cytomorphologic characterization and cell quantification for peripheral blood smears (PBS). To this end, we aimed to be one of the few pioneering institutes in the United States to adopt early and implement this technology into our routine workflow as a 'hub and spoke' model for optimized case assessment, data sharing and result reporting across multiple satellite locations within our hospital health system. DESIGN A Scopio x100 digital scanner was deployed at our main hospital site, with an anticipated secondary scanner for installment at a satellite laboratory. PBS flagged for hematopathologist review from two satellite laboratories were scanned, and full-field digitalized slides were evaluated by hematopathologists following AI automated analyses. RESULTS 311 peripheral smears were scanned since April 2021 and representative slides were digitalized at 100x magnification (Figure 1, weblink: https://demo.scopiolabs.com/#/view_scan/9231acaf-f898-4649-950d-a41c26c2baaa) with rapid monolayer, monolayer, full-field, and full-field cytopenia scan options available. The automated AI capabilities classified cells into lineage-specific categories with quantification based on cytomorphologic features (Figure 2). Other AI features include additional cell assignment, cell annotation and comments accessible to all users, finalized report PDF generation, export, upload into our current PowerPath TM software with linkage to the corresponding flow cytometry and bone marrow biopsy reports; and the ability to share digitalized slides with clinicians, laboratory personnel and trainees using uniquely generated weblinks. Images can be used for lectures and tumor boards. Additionally, an 80-case study set for PBS was created for medical students, residents and fellow teaching purposes, including cases displaying acute B-cell lymphoblastic leukemia (B-ALL), acute myelomonocytic leukemia (AMML), hypersegmented neutrophils in COVID-19(+) patients, myelodysplastic syndrome (MDS), atypical lymphocytes, hemoglobinopathies, platelet disorders and various lymphomas. Overall improvements were made to the following areas: CLINICAL WORK/DIAGNOSIS 1. Time-saving due to pre-categorization of cells into lineage-specific groups for pathologist review 2. Minimizes subjectivity in cell counting and cellularity assessment EDUCATION 1. Case-based collection with flow and molecular being maintained here 2. Efficient case retrieval with retained annotations/comments for teaching purposes 3. Wide array of digitalized images for hematology atlas and publications ARCHIVING 1. Collection of reference images (intra/inter departmental) for an array of morphological entities for clinical reference and refined diagnosis (e.g. Bethesda reference images for pap by ASC) 2. Digital catalogue for long-term case follow-up and retrospective review CONCLUSION The Scopio Labs X100 digital system provides an efficient and cost-effective web-based tool to streamline clinical workflow and enhance PBS evaluation. With its recent AI capabilities of cell quantification, lineage-assignment and report-generation, we aim to continue our efforts to fully integrate Scopio Labs into our routine daily clinical workflow for reviewing PBS specimens. CONFLICT OF INTEREST STATEMENT The authors have nothing to disclose with regard to the submitted work Figure 1 Figure 1. Disclosures No relevant conflicts of interest to declare.