Real-time unusual user event detection algorithm fusing vision, audio, activity, and dust patterns

Author(s):  
Juho Jung ◽  
Ryumduk Oh ◽  
Gwang Lee ◽  
Junho Ahn
2021 ◽  
Author(s):  
Lucian Toader ◽  
Paulinus Abhyudaya Bimastianto ◽  
Shreepad Purushottam Khambete ◽  
Suhail Mohammed Al Ameri ◽  
Erwan Couzigou ◽  
...  

Abstract In a drive to enhance drilling operational awareness, the Real-Time Operations Center (RTOC) has developed a State-of-the-Art event detection algorithm that consistently highlights the deviations of critical parameters by actively comparing real-time values against comprehensive physical models and alerting the users through a dashboard. The process relies on different levels of frequency and severity in order to detect events at their onset and prevent developing into a situation that compromises the operations. The first pillar of the solution consists of deterministic modelling of the expected values for a series of parameters in order to provide the basis for comparison and diagnostics. The main parameters sought to be modelled consist of the Standpipe Pressure, the Rotary Torque and the Hook load, which respectively are generated through individual methods taking into consideration actual conditions as well as relevant contextual data to ensure accuracy. The second pillar of the solution consists of visual alerts, triggered and displayed on a dashboard based on frequency and severity levels, as percentage of deviation from accepted operational envelope. The solution has been initially implemented during drilling operations where different issues were expected to take place, finding that whenever such occurrences took place, the algorithms were able to signal potential events in most of the cases. Some challenges were observed mainly due to sensor calibration and behavior since the expected model values not necessarily match reality, including residual pressure when the pumps are off or when the string is set on slips but the hook load values still present some variance. Also, it has been observed during transient periods where flow and rotation are changed drastically, that the stabilization to a steady state present with high variance, which has demanded the introduction of further logics within the algorithms to account for these effects and avoid the generation of false indications of issues. The solution has given encouraging results thus far in signaling different dysfunctions on the drilling process without the need of immediate human interpretation of data, which has allowed to move forward in the digitalization of operations, not only by timely signaling the onset of issues, but as well by providing the basis to further develop real time diagnosis of the problems to accelerate their resolution. The conception of the event detection based on deterministic real time analysis of individual channels against robust physical models from the existing digital twin solution has proven an immediate asset for operations on its own. By providing clear signaling of issues, while providing a solid framework to ultimately develop a diagnostic solution to translate a potential event into a proactive approach to support decision making process.


2019 ◽  
Vol 9 (18) ◽  
pp. 3650 ◽  
Author(s):  
Hasan Tariq ◽  
Farid Touati ◽  
Mohammed Abdulla E. Al-Hitmi ◽  
Damiano Crescini ◽  
Adel Ben Mnaouer

Earthquakes are one of the major natural calamities as well as a prime subject of interest for seismologists, state agencies, and ground motion instrumentation scientists. The real-time data analysis of multi-sensor instrumentation is a valuable knowledge repository for real-time early warning and trustworthy seismic events detection. In this work, an early warning in the first 1 micro-second and seismic wave detection in the first 1.7 milliseconds after event initialization is proposed using a seismic wave event detection algorithm (SWEDA). The SWEDA with nine low-computation-cost operations is being proposed for smart geospatial bi-axial inclinometer nodes (SGBINs) also utilized in structural health monitoring systems. SWEDA detects four types of seismic waves, i.e., primary (P) or compression, secondary (S) or shear, Love (L), and Rayleigh (R) waves using time and frequency domain parameters mapped on a 2D mapping interpretation scheme. The SWEDA proved automated heterogeneous surface adaptability, multi-clustered sensing, ubiquitous monitoring with dynamic Savitzky–Golay filtering and detection using nine optimized sequential and structured event characterization techniques. Furthermore, situation-conscious (context-aware) and automated computation of short-time average over long-time average (STA/LTA) triggering parameters by peak-detection and run-time scaling arrays with manual computation support were achieved.


2021 ◽  
Vol 3 (5) ◽  
Author(s):  
João Gaspar Ramôa ◽  
Vasco Lopes ◽  
Luís A. Alexandre ◽  
S. Mogo

AbstractIn this paper, we propose three methods for door state classification with the goal to improve robot navigation in indoor spaces. These methods were also developed to be used in other areas and applications since they are not limited to door detection as other related works are. Our methods work offline, in low-powered computers as the Jetson Nano, in real-time with the ability to differentiate between open, closed and semi-open doors. We use the 3D object classification, PointNet, real-time semantic segmentation algorithms such as, FastFCN, FC-HarDNet, SegNet and BiSeNet, the object detection algorithm, DetectNet and 2D object classification networks, AlexNet and GoogleNet. We built a 3D and RGB door dataset with images from several indoor environments using a 3D Realsense camera D435. This dataset is freely available online. All methods are analysed taking into account their accuracy and the speed of the algorithm in a low powered computer. We conclude that it is possible to have a door classification algorithm running in real-time on a low-power device.


Sign in / Sign up

Export Citation Format

Share Document