Rescaling Egocentric Vision: Collection, Pipeline and Challenges for EPIC-KITCHENS-100

This paper introduces the pipeline to extend the largest dataset in egocentric vision, EPIC-KITCHENS. The effort culminates in EPIC-KITCHENS-100, a collection of 100 hours, 20M frames, 90K actions in 700 variable-length videos, capturing long-term unscripted activities in 45 environments, using head-mounted cameras. Compared to its previous version (Damen in Scaling egocentric vision: ECCV, 2018), EPIC-KITCHENS-100 has been annotated using a novel pipeline that allows denser (54% more actions per minute) and more complete annotations of fine-grained actions (+128% more action segments). This collection enables new challenges such as action detection and evaluating the “test of time”—i.e. whether models trained on data collected in 2018 can generalise to new footage collected two years later. The dataset is aligned with 6 challenges: action recognition (full and weak supervision), action detection, action anticipation, cross-modal retrieval (from captions), as well as unsupervised domain adaptation for action recognition. For each challenge, we define the task, provide baselines and evaluation metrics.

3D Hand Pose Estimation in Point Cloud Using 3D Convolutional Neural Network on Egocentric Datasets

3D hand pose estimation from egocentric vision is an important study in the construction of assistance systems and modeling of robot hand in robotics. In this paper, we propose a complete method for estimating 3D hand posefrom the complex scene data obtained from the egocentric sensor. In which we propose a simple yet highly efficient pre-processing step for hand segmentation. In the estimation process, we used the Hand PointNet (HPN), V2V-PoseNet(V2V), Point-to-Point Regression PointNet (PtoP) for finetuning to estimate the 3D hand pose from the collected data obtained from the egocentric sensor, such as CVRA, FPHA (First-Person Hand Action) datasets. HPN, V2V, PtoP are thedeep networks/Convolutional Neural Networks (CNNs) for estimating 3D hand pose that uses the point cloud data of the hand. We evaluate the estimation results using the preprocessing step and do not use the pre-processing step to see the effectiveness of the proposed method. The results show that 3D distance error is increased many times compared to estimates on the hand datasets are not obstructed (the hand data obtained from surveillance cameras, are viewed from top view, front view, sides view) such as MSRA, NYU, ICVL datasets. The results are quantified, analyzed, shown on the point cloud data of CVAR dataset and projected on the color image of FPHA dataset.

Multimodal multi-pedestrian path prediction for autonomous cars

Accurate prediction of the future position of pedestrians in traffic scenarios is required for safe navigation of an autonomous vehicle but remains a challenge. This concerns, in particular, the effective and efficient multimodal prediction of most likely trajectories of tracked pedestrians from egocentric view of self-driving car. In this paper, we present a novel solution, named M2P3, which combines a conditional variational autoencoder with recurrent neural network encoder-decoder architecture in order to predict a set of possible future locations of each pedestrian in a traffic scene. The M2P3 system uses a sequence of RGB images delivered through an internal vehicle-mounted camera for egocentric vision. It takes as an input only two modes, that are past trajectories and scales of pedestrians, and delivers as an output the three most likely paths for each tracked pedestrian. Experimental evaluation of the proposed architecture on the JAAD, ETH/UCY and Stanford Drone datasets reveal that the M2P3 system is significantly superior to selected state-of-the-art solutions.

The Slovak “Narcissus” with Croatian roots. Rudolf Sloboda, a writer

Rudolf Sloboda is one of the brightest and most distinctive writers of the generation of the Slovak “sixties”. He was born and lived most of his life in the village of Devinska Nova Ves near Bratislava with a predominantly Croatian population. Sloboda is the author of dozens of works, including novels, stories, short stories, essays, poems, plays, film scripts. In his work, he was based on the original “egocentric” vision of reality and the confessional-monologue type of narration. The themes of his largely autobiographical prose and drama were complex, often painful relationships between people, crisis states of the personality — everything he faced in his own life. The main space of Sloboda’s books is his native village, with its constants and inevitable transformation. The novels of the writer, first of all — “The Narcissus” (1965), “The Reason” (1982) and “The Blood” (1991), reflect the most important stages in the life and mental wavering of the author and his hero: the early youth marked by entering into an unknown social environment and his first erotic experiences; the maturity with family problems and setbacks, psychological crisis; approaching the old age with the extinction of feelings and desires, that lead to inner emptiness. The universal sound of “private” statements about the existential problems of a person, the artistic persuasiveness, originality and recognizability of his style — all this makes the works of Rudolf Sloboda a part of the Gold Reserve of the modern Slovak literature.