Attention-based CNN for Weakly Labeled Sensors-based HAR
The weakly labeled data inevitably occurs in the process of sensors-based data collection, which may impact the performance of traditional sensors-based human activity recognition methods. Thus, we proposed the attention-based CNN, which utilizes an attention mechanism to enhance the CNN backbone model’s generalization ability to the weakly labeled samples.
Paper Info
- Title: Attention-based convolutional neural network for weakly labeled human activities’ recognition with wearable sensors
- Author(s): K Wang, J He, L Zhang
- Conference/Journal Name: IEEE Sensors Journal
- Date: 2019
- Link: IEEE Xplore
- GitHub: Attention-for-HAR
Abstract
Traditional methods of human activity recognition usually require a large amount of strictly labeled data for training classifiers. However, it is hard for one to keep a fixed activity when collecting desired activity data by wearable sensors, and the weakly labeled data inevitably occurs in the process of data collection. For now, human activity recognition methods have seldom been researched according to weakly labeled data, which deserves deep investigation. In this paper, we proposed a novel attention-based human activity recognition method to process the weakly labeled activity data. The traditional convolutional neural network (CNN)-based human activity recognition is modified by attention mechanism, which computes the compatibility between the global features extracted at the final fully connected layers and the local features extracted at a given convolutional layer. The attention-based CNN architecture can amplify the salient activity information and suppress the irrelevant and potentially confusing information by weighing up their compatibility. Our methods are compared with two state-of-the-art methods, CNN and DeepConvLSTM. The experimental results show that our model is comparably well on the traditional UCI HAR dataset and outperforms them on the weakly labeled dataset in accuracy. Our method can greatly facilitate the process of sensor data annotation and makes data collection easier.
Citation
If you find this idea helpful, please consider citing:
@article{wang2019attention,
title={Attention-based convolutional neural network for weakly labeled human activities’ recognition with wearable sensors},
author={Wang, Kun and He, Jun and Zhang, Lei},
journal={IEEE Sensors Journal},
volume={19},
number={17},
pages={7598--7604},
year={2019},
publisher={IEEE}
}