Approach to Automated Visual Inspection of Objects Based on Artificial Intelligence

The article discusses the possibility of object detector usage in field of automated visual inspection for objects with specific parameters, specifically various types of defects occurring on the surface of a car tire. Due to the insufficient amount of input data, as well as the need to speed up the development process, the Transfer Learning principle was applied in a designed system. In this approach, the already pre-trained convolutional neural network AlexNet was used, subsequently modified in its last three layers, and again trained on a smaller sample of our own data. The detector used in the designed camera inspection system with the above architecture allowed us to achieve the accuracy and versatility needed to detect elements (defects) whose shape, dimensions and location change with each occurrence. The design of a test facility with the application of a 12-megapixel monochrome camera over the rotational table is briefly described, whose task is to ensure optimal conditions during the scanning process. The evaluation of the proposed control system with the quantification of the recognition capabilities in the individual defects is described at the end of the study. The implementation and verification of such an approach together with the proposed methodology of the visual inspection process of car tires to obtain better classification results for six different defect classes can be considered as the main novel feature of the presented research. Subsequent testing of the designed system on a selected batch of sample images (containing all six types of possible defect) proved the functionality of the entire system while the highest values of successful defect detection certainty were achieved from 85.15% to 99.34%.

Redefining Global Economic Thinking for the Welfare of Society

This chapter examines the legal and financial control issues regarding compliance with labor legislation. On the one hand, the legal analysis shows that legislation is one of the main factors influencing the financial control practice for compliance with labour legislation. On the other hand, the problems and specifics of the control procedures applied by the General Labor Inspectorate Executive Agency in Bulgaria are presented. The overall inspection process is presented sequentially, analyzing the individual stages that the control procedures go through. The problems and the specifics of carrying out an independent inspection activity by the agency are presented, and the peculiarities of carrying out joint control activities with executive bodies or their administrative structures by the specialized administration are examined. Different types of factors that influence the implementation of control procedures by the General Labor Inspectorate Executive Agency in Bulgaria are considered.

Evaluation of Influence Factors on the Visual Inspection Performance of Aircraft Engine Blades

Background—There are various influence factors that affect visual inspection of aircraft engine blades including type of inspection, defect type, severity level, blade perspective and background colour. The effect of those factors on the inspection performance was assessed. Method—The inspection accuracy of fifty industry practitioners was measured for 137 blade images, leading to N = 6850 observations. The data were statistically analysed to identify the significant factors. Subsequent evaluation of the eye tracking data provided additional insights into the inspection process. Results—Inspection accuracies in borescope inspections were significantly lower compared to piece-part inspection at 63.8% and 82.6%, respectively. Airfoil dents (19.0%), cracks (11.0%), and blockage (8.0%) were the most difficult defects to detect, while nicks (100.0%), tears (95.5%), and tip curls (89.0%) had the highest detection rates. The classification accuracy was lowest for airfoil dents (5.3%), burns (38.4%), and tears (44.9%), while coating loss (98.1%), nicks (90.0%), and blockage (87.5%) were most accurately classified. Defects of severity level S1 (72.0%) were more difficult to detect than increased severity levels S2 (92.8%) and S3 (99.0%). Moreover, visual perspectives perpendicular to the airfoil led to better inspection rates (up to 87.5%) than edge perspectives (51.0% to 66.5%). Background colour was not a significant factor. The eye tracking results of novices showed an unstructured search path, characterised by numerous fixations, leading to longer inspection times. Experts in contrast applied a systematic search strategy with focus on the edges, and showed a better defect discrimination ability. This observation was consistent across all stimuli, thus independent of the influence factors. Conclusions—Eye tracking identified the challenges of the inspection process and errors made. A revised inspection framework was proposed based on insights gained, and support the idea of an underlying mental model.

A novel approach for detection and classification of re-entrant crack using modified CNNetwork

Purpose In the purpose of the section, the cracks that are in the construction domain may be common and usually fixed with the human inspection which is at the visible range, but for the cracks which may exist at the distant place for the human eye in the same building but can be captured with the camera. If the crack size is quite big can be visible but few cracks will be present due to the flaws in the construction of walls which needs authentic information and confirmation about it for the successful completion of the wall cracks, as these cracks in the wall will result in the structure collapse. Design/methodology/approach In the modern era of digital image processing, it has captured the importance in all the domain of engineering and all the fields irrespective of the division of the engineering, hence, in this research study an attempt is made to deal with the wall cracks which are found or searched during the building inspection process, in the present context in association with the unique U-net architecture is used with convolutional neural network method. Findings In the construction domain, the cracks may be common and usually fixed with the human inspection which is at the visible range, but for the cracks which may exist at the distant place for the human eye in the same building but can be captured with the camera. If the crack size is quite big can be visible but few cracks will be present due to the flaws in the construction of walls which needs authentic information and confirmation about it for the successful completion of the wall cracks, as these cracks in the wall will result in the structure collapse. Hence, for the modeling of the proposed system, it is considered with the image database from the Mendeley portal for the analysis. With the experimental analysis, it is noted and observed that the proposed system was able to detect the wall cracks, search the flat surface by the result of no cracks found and it is successful in dealing with the two phases of operation, namely, classification and segmentation with the deep learning technique. In contrast to other conventional methodologies, the proposed methodology produces excellent performance results. Originality/value The originality of the paper is to find the portion of the cracks on the walls using deep learning architecture.

Detecting Teeth Defects on Automotive Gears Using Deep Learning

Gears are a vital component in many complex mechanical systems. In automotive systems, and in particular vehicle transmissions, we rely on them to function properly on different types of challenging environments and conditions. However, when a gear is manufactured with a defect, the gear’s integrity can become compromised and lead to catastrophic failure. The current inspection process used by an automotive gear manufacturer in Guelph, Ontario, requires human operators to visually inspect all gear produced. Yet, due to the quantity of gears manufactured, the diverse array of defects that can arise, the time requirements for inspection, and the reliance on the operator’s inspection ability, the system suffers from poor scalability, and defects can be missed during inspection. In this work, we propose a machine vision system for automating the inspection process for gears with damaged teeth defects. The implemented inspection system uses a faster R-CNN network to identify the defects, and combines domain knowledge to reduce the manual inspection of non-defective gears by 66%.

Analysis of the Distributed Immune Inspection Equipment Sensor Scheduling Model Based on Adaptive Dynamic Probabilistic Particle Swarm Optimization

Based on the analysis of bacterial parasitic behavior and biological immune mechanism, this paper puts forward the basic idea and implementation method of an embedding adaptive dynamic probabilistic parasitic immune mechanism into a particle swarm optimization algorithm and constructs particle swarm optimization based on an adaptive dynamic probabilistic parasitic immune mechanism algorithm. The specific idea is to use the elite learning mechanism for the parasitic group with a strong parasitic ability to improve the ability of the algorithm to jump out of the local extreme value, and the host will generate acquired immunity against the parasitic behavior of the parasitic group to enhance the diversity of the host population’s particles. Parasitic behavior occurs when the number of times reaches a predetermined algebra. In this paper, an example simulation is carried out for the prescheduling and dynamic scheduling of immune inspection. The effectiveness of prescheduling for immune inspection is verified, and the rules constructed by the adaptive dynamic probability particle swarm algorithm and seven commonly used scheduling rules are tested on two common dynamic events of emergency task insertion and subdistributed immune inspection equipment failure. In contrast, the experimental data was analyzed. From the analysis of experimental results, under the indicator of minimum completion time, the overall performance of the adaptive dynamic probability particle swarm optimization algorithm in 20 emergency task insertion instances and 20 subdistributed immune inspection equipment failure instances is better than that of seven scheduling rules. Therefore, in the two dynamic events of emergency task insertion and subdistributed immune inspection equipment failure, the adaptive dynamic probabilistic particle swarm algorithm proposed in this paper can construct effective scheduling rules for the rescheduling of the system when dynamic events occur and the constructed scheduling. The performance of the rules is better than that of the commonly used scheduling rules. Among the commonly used scheduling rules, the performance of the FIFO scheduling rules is also better. In general, the immune inspection scheduling multiagent system in this paper can complete the prescheduling of immune inspection and process dynamic events of the inspection process and realize the prereactive scheduling of the immune inspection process.

Underwater Inspection Using ROV

ADNOC Drilling operates a growing fleet of 22 jack up units. These units require various inspections and tests to ensure that their integrity is maintained while conducting the drilling operations. One of these inspections is the underwater inspection which is required to be carried out twice every 5 years. Traditionally, this inspection is carried out by divers at the shipyard where it is safe for divers to carry out cleaning, visual inspections and NDT of structural welds. Moving the rig to a drydock or a shipyard is a costly and involves a lot of activities related to safety in addition to the out of service time. Loss of revenue is experienced while the rig is out of service, as well as costs associated to the survey, shipyard costs, vessel costs etc. all combining to create an expensive inspection process. ADNOC Drilling Marine and Group Technology adapted a new method for performing the full scope of the underwater inspection offshore using small remotely operated vehicles (ROV), most of the scope is carried out while the rig remains in full operation (while drilling).

A Computer-Aided Diagnosis System Using Deep Learning for Multiclass Skin Lesion Classification

In the USA, each year, almost 5.4 million people are diagnosed with skin cancer. Melanoma is one of the most dangerous types of skin cancer, and its survival rate is 5%. The development of skin cancer has risen over the last couple of years. Early identification of skin cancer can help reduce the human mortality rate. Dermoscopy is a technology used for the acquisition of skin images. However, the manual inspection process consumes more time and required much cost. The recent development in the area of deep learning showed significant performance for classification tasks. In this research work, a new automated framework is proposed for multiclass skin lesion classification. The proposed framework consists of a series of steps. In the first step, augmentation is performed. For the augmentation process, three operations are performed: rotate 90, right-left flip, and up and down flip. In the second step, deep models are fine-tuned. Two models are opted, such as ResNet-50 and ResNet-101, and updated their layers. In the third step, transfer learning is applied to train both fine-tuned deep models on augmented datasets. In the succeeding stage, features are extracted and performed fusion using a modified serial-based approach. Finally, the fused vector is further enhanced by selecting the best features using the skewness-controlled SVR approach. The final selected features are classified using several machine learning algorithms and selected based on the accuracy value. In the experimental process, the augmented HAM10000 dataset is used and achieved an accuracy of 91.7%. Moreover, the performance of the augmented dataset is better as compared to the original imbalanced dataset. In addition, the proposed method is compared with some recent studies and shows improved performance.

Detection of Foreign Bodies in Soft Foods Employing Tactile Image Sensor

In the inspection work involving foodstuffs in food factories, there are cases where people not only visually inspect foodstuffs, but must also physically touch foodstuffs with their hands to find foreign or undesirable objects mixed in the product. To contribute to the automation of the inspection process, this paper proposes a method for detecting foreign objects in food based on differences in hardness using a camera-based tactile image sensor. Because the foreign objects to be detected are often small, the tactile sensor requires a high spatial resolution. In addition, inspection work in food factories requires a sufficient inspection speed. The proposed cylindrical tactile image sensor meets these requirements because it can efficiently acquire high-resolution tactile images with a camera mounted inside while rolling the cylindrical sensor surface over the target object. By analyzing the images obtained from the tactile image sensor, we detected the presence of foreign objects and their locations. By using a reflective membrane-type sensor surface with high sensitivity, small and hard foreign bodies of sub-millimeter size mixed in with soft food were successfully detected. The effectiveness of the proposed method was confirmed through experiments to detect shell fragments left on the surface of raw shrimp and bones left in fish fillets.

3D Laser Triangulation and Deep Learning Approach to Tunnel Inspection

Regular inspection of tunnel surfaces is an important practice from both a safety and tunnel asset management perspective. However, inspection for cracking and spalling is still predominantly a manual task, which is time consuming, subjective, and exposes on-foot staff to risk. This presentation will explore the use of 3D laser scanning technology and artificial intelligence to automate the inspection process with a Canadian metro case study being presented.