Towards the Internet of Behaviors in Smart Cities through a Fog-To-Cloud Approach

Recent advances in Internet of Things (IoT) and the rising of the Internet of Behavior (IoB) have made it possible to develop real-time improved traveler assistance tools for mobile phones, assisted by cloud-based machine learning, and using fog computing in between IoT and the Cloud. Within the Horizon2020-funded mF2C project an Android app has been developed exploiting the proximity marketing concept and covers the essential path through the airport onto the flight, from the least busy security queue through to the time to walk to gate, gate changes, and other obstacles that airports tend to entertain travelers with. It gives chance to travelers to discover the facilities of the airport, aided by a recommender system using machine learning, that can make recommendations and offer voucher according with the traveler’s preferences or on similarities to other travelers. The system provides obvious benefits to the airport planners, not only people tracking in the shops area, but also aggregated and anonymized view, like heat maps that can highlight bottlenecks in the infrastructure, or suggest situations that require intervention, such as emergencies. With the emerging of the COVID pandemic the tool could be adapted to help in the social distancing to guarantee safety. The use of the fog-to-cloud platform and the fulfilling of all centricity and privacy requirements of the IoB give evidence of the impact of the solution. Doi: 10.28991/HIJ-2021-02-04-01 Full Text: PDF

Human Activity Recognition Using The Human Skeleton Provided by Kinect

In this paper, a new method is proposed for people tracking using the human skeleton provided by the Kinect sensor, Our method is based on skeleton data, which includes the coordinate value of each joint in the human body. For data classification, the Support Vector Machine (SVM) and Random Forest techniques are used. To achieve this goal, 14 classes of movements are defined, using the Kinect Sensor to extract data containing 46 features and then using them to train the classification models. The system was tested on 12 subjects, each of whom performed 14 movements in each experiment. Experiment results show that the best average accuracy is 90.2 % for the SVM model and 99 % for the Random forest model. From the experiments, we concluded that the best distance between the Kinect sensor and the human body is one meter.

Cooperative People Tracking by Distributed Cameras Network

In the application of video surveillance, reliable people detection and tracking are always challenging tasks. The conventional single-camera surveillance system may encounter difficulties such as narrow-angle of view and dead space. In this paper, we proposed multi-cameras network architecture with an inter-camera hand-off protocol for cooperative people tracking. We use the YOLO model to detect multiple people in the video scene and incorporate the particle swarm optimization algorithm to track the person movement. When a person leaves the area covered by a camera and enters an area covered by another camera, these cameras can exchange relevant information for uninterrupted tracking. The motion smoothness (MS) metrics is proposed for evaluating the tracking quality of multi-camera networking system. We used a three-camera system for two persons tracking in overlapping scene for experimental evaluation. Most tracking person offsets at different frames were lower than 30 pixels. Only 0.15% of the frames showed abrupt increases in offsets pixel. The experiment results reveal that our multi-camera system achieves robust, smooth tracking performance.

Vehicle Vacant Seat Identification and Mask Detection using Image processing

This article describes the technique of real-time face detection, mask detection, and vacant seat available in the vehicle. There are so many technologies for finding seat availability in the vehicle. But image processing technology is very popular today. Face detection is part of image processing. It is used to find the face of a human being in a certain area. Face detection is used in many applications, such as facial recognition, people tracking or photography. In this paper, the face detection technique is used to detect the vacant seat availability in the vehicle and also to detect whether the passenger wear the mask on his face or not. The webcam is installed in the vehicle and connected with the Raspberry Pi 3 model B. When the vehicle leaves the station, the webcam will capture images of the passengers in the seating area. The webcam will be mounted on the vehicle. The images will be adjusted and enhanced to reduce noise made by the software application. The system obtains the maximum number of passengers in the vehicle that processes the images and then calculates the availability of seats in the vehicle. In covid-19 situation mask detection is necessary. so this system also used to detect the mask on face.

Measurement Noise Model for Depth Camera-Based People Tracking

Depth cameras are widely used in people tracking applications. They typically suffer from significant range measurement noise, which causes uncertainty in the detections made of the people. The data fusion, state estimation and data association tasks require that the measurement uncertainty is modelled, especially in multi-sensor systems. Measurement noise models for different kinds of depth sensors have been proposed, however, the existing approaches require manual calibration procedures which can be impractical to conduct in real-life scenarios. In this paper, we present a new measurement noise model for depth camera-based people tracking. In our tracking solution, we utilise the so-called plan-view approach, where the 3D measurements are transformed to the floor plane, and the tracking problem is solved in 2D. We directly model the measurement noise in the plan-view domain, and the errors that originate from the imaging process and the geometric transformations of the 3D data are combined. We also present a method for directly defining the noise models from the observations. Together with our depth sensor network self-calibration routine, the approach allows fast and practical deployment of depth-based people tracking systems.

A Systematic Deep Learning Based Overhead Tracking and Counting System Using RGB-D Remote Cameras

Automatic head tracking and counting using depth imagery has various practical applications in security, logistics, queue management, space utilization and visitor counting. However, no currently available system can clearly distinguish between a human head and other objects in order to track and count people accurately. For this reason, we propose a novel system that can track people by monitoring their heads and shoulders in complex environments and also count the number of people entering and exiting the scene. Our system is split into six phases; at first, preprocessing is done by converting videos of a scene into frames and removing the background from the video frames. Second, heads are detected using Hough Circular Gradient Transform, and shoulders are detected by HOG based symmetry methods. Third, three robust features, namely, fused joint HOG-LBP, Energy based Point clouds and Fused intra-inter trajectories are extracted. Fourth, the Apriori-Association is implemented to select the best features. Fifth, deep learning is used for accurate people tracking. Finally, heads are counted using Cross-line judgment. The system was tested on three benchmark datasets: the PCDS dataset, the MICC people counting dataset and the GOTPD dataset and counting accuracy of 98.40%, 98%, and 99% respectively was achieved. Our system obtained remarkable results.