Joint Adversarial Domain Adaptation for Resilient WiFi-Enabled Device-Free Gesture Recognition

Author(s):  
Han Zou ◽  
Jianfei Yang ◽  
Yuxun Zhou ◽  
Costas J. Spanos
2021 ◽  
Vol 18 (2) ◽  
pp. 186-199
Author(s):  
Jie Wang ◽  
Zhouhua Ran ◽  
Qinghua Gao ◽  
Xiaorui Ma ◽  
Miao Pan ◽  
...  

2021 ◽  
Author(s):  
Zhenyue Gao ◽  
Jianqiang Xue ◽  
Jianxing Zhang ◽  
Wendong Xiao

Abstract Accurate sensing and understanding of gestures can improve the quality of human-computer interaction, and has great theoretical significance and application potentials in the fields of smart home, assisted medical care, and virtual reality. Device-free wireless gesture recognition based on WiFi Channel State Information (CSI) requires no sensors, and has a series of advantages such as permission for non-line-of-sight scenario, low cost, preserving for personal privacy and working in the dark night. Although most of the current gesture recognition approaches based on WiFi CSI have achieved good performance, they are difficult to adapt to the new domains. Therefore, this paper proposes ML-WiGR, an approach for device-free gesture recognition in cross-domain applications. ML-WiGR applies convolutional neural networks (CNN) and long short-term memory (LSTM) neural networks as the basic model for gesture recognition to extract spatial and temporal features. Combined with the meta learning training mechanism, the approach dynamically adjusts the learning rate and meta learning rate in training process adaptively, and optimizes the initial parameters of a basic model for gesture recognition, only using a few samples and several iterations to adapt to new domain. In the experiments, we validate the approach under a variety of scenarios. The results show that ML-WiGR can achieve comparable performance against existing approaches with only a small number of samples for training in cross domains.


Author(s):  
Liying Wang ◽  
Zongyong Cui ◽  
Yiming Pi ◽  
Changjie Cao ◽  
Zongjie Cao

Author(s):  
Han Zou ◽  
Yuxun Zhou ◽  
Jianfei Yang ◽  
Huihan Liu ◽  
Hari Prasanna Das ◽  
...  

We propose a novel domain adaptation framework, namely Consensus Adversarial Domain Adaptation (CADA), that gives freedom to both target encoder and source encoder to embed data from both domains into a common domaininvariant feature space until they achieve consensus during adversarial learning. In this manner, the domain discrepancy can be further minimized in the embedded space, yielding more generalizable representations. The framework is also extended to establish a new few-shot domain adaptation scheme (F-CADA), that remarkably enhances the ADA performance by efficiently propagating a few labeled data once available in the target domain. Extensive experiments are conducted on the task of digit recognition across multiple benchmark datasets and a real-world problem involving WiFi-enabled device-free gesture recognition under spatial dynamics. The results show the compelling performance of CADA versus the state-of-the-art unsupervised domain adaptation (UDA) and supervised domain adaptation (SDA) methods. Numerical experiments also demonstrate that F-CADA can significantly improve the adaptation performance even with sparsely labeled data in the target domain.


2020 ◽  
Vol 16 (1) ◽  
pp. 228-237 ◽  
Author(s):  
Xiaorui Ma ◽  
Yunong Zhao ◽  
Liang Zhang ◽  
Qinghua Gao ◽  
Miao Pan ◽  
...  

2021 ◽  
Author(s):  
Jianxiao Xie ◽  
Wei Ye ◽  
Kai Xu

Abstract Internet of Things (IoT) expects to incorporate massive machine-type (MCT) devices, such as vehicles, sensors, and wearable devices, which brings a large number of application tasks that need to be processed. Additionally, data collected from various devices needs to be executed and processed in a timely, reliable, and efficient manner. Gesture recognition has enabled IoT applications such as human-computer interaction and virtual reality. In this work, we propose a cross-domain device-free gesture recognition (DFGR) model, that exploits 3D-CNN to obtain spatiotemporal features in Wi-Fi sensing. To adapt the sensing data to the 3D model, we carry out 3D data segment and supplement in addition to signal denoising and time-frequency transformation. We demonstrate that our proposed model outperforms the state-of-the-art method in the application of DFGR even cross 3 domain factors simultaneously, and is easy to converge and convenient for training with a less complicated hierarchical structure.


Sign in / Sign up

Export Citation Format

Share Document