Toggle Main Menu Toggle Search

Open Access padlockePrints

ConvBoost: Boosting ConvNets for Sensor-based Activity Recognition

Lookup NU author(s): Bing Zhai, Professor Paolo MissierORCiD

Downloads


Licence

This work is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).


Abstract

© 2023 Owner/Author.Human activity recognition (HAR) is one of the core research themes in ubiquitous and wearable computing. With the shift to deep learning (DL) based analysis approaches, it has become possible to extract high-level features and perform classification in an end-to-end manner. Despite their promising overall capabilities, DL-based HAR may suffer from overfitting due to the notoriously small, often inadequate, amounts of labeled sample data that are available for typical HAR applications. In response to such challenges, we propose ConvBoost - a novel, three-layer, structured model architecture and boosting framework for convolutional network based HAR. Our framework generates additional training data from three different perspectives for improved HAR, aiming to alleviate the shortness of labeled training data in the field. Specifically, with the introduction of three conceptual layers - Sampling Layer, Data Augmentation Layer, and Resilient Layer - we develop three "boosters"- R-Frame, Mix-up, and C-Drop - to enrich the per-epoch training data by dense-sampling, synthesizing, and simulating, respectively. These new conceptual layers and boosters, that are universally applicable for any kind of convolutional network, have been designed based on the characteristics of the sensor data and the concept of frame-wise HAR. In our experimental evaluation on three standard benchmarks (Opportunity, PAMAP2, GOTOV) we demonstrate the effectiveness of our ConvBoost framework for HAR applications based on variants of convolutional networks: vanilla CNN, ConvLSTM, and Attention Models. We achieved substantial performance gains for all of them, which suggests that the proposed approach is generic and can serve as a practical solution for boosting the performance of existing ConvNet-based HAR models. This is an open-source project, and the code can be found at https://github.com/sshao2013/ConvBoost.


Publication metadata

Author(s): Shao S, Guan Y, Zhai B, Missier P, Plotz T

Publication type: Article

Publication status: Published

Journal: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Year: 2023

Volume: 7

Issue: 2

Online publication date: 12/06/2023

Acceptance date: 02/04/2023

Date deposited: 10/07/2023

ISSN (electronic): 2474-9567

Publisher: Association for Computing Machinery

URL: https://doi.org/10.1145/3596234

DOI: 10.1145/3596234


Altmetrics

Altmetrics provided by Altmetric


Share