Skip to content

Encoding human activity by considering salient sensors and time points.

Notifications You must be signed in to change notification settings

isukrit/encodingHumanActivity

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Deep ConvLSTM with self-attention for human activity decoding using wearables.

In this git repository we implement the proposed novel architecture for encoding human activity data for body sensors. The proposed model encodes the sensor data in both the spatial domain (whereby it selects important sensors) and the time domain (whereby it selects important time points).

If you're using our code, please cite our paper (available on ArXiV): S. P. Singh, M. K. Sharma, A. Lay-Ekuakille, D. Gangwar and S. Gupta, "Deep ConvLSTM with self-attention for human activity decoding using wearable sensors," in IEEE Sensors Journal, doi: 10.1109/JSEN.2020.3045135.

proposed Architecture

We have added codes for two of models that we tested:

  • Baseline CNN + LSTM model
  • Proposed model with self-attention

Setup

pip3 install -r requirements.txt

Guide to run the code

  1. The data for the subjects resides in the data directory. You can create subdir for the arrangement and the dataset.npy file as data/arrangement/dataset.npz. We used the processed data from here and put it in the data folder. For example: 'data/LOTO/MHEALTH.npz' file depicts the leave one trial out (LOTO) for the MHEALTH dataset.

  2. The codes reside in the codes folder.

  • codes/model_baseline: This folder contains the Python code for training a baseline model containing CNN and RNN layers. You can run the code by running the following command:
python3 model_baseline.py
  • codes/model_proposed: This folder contains the Python code for training the proposed model built using Keras and Tensorflow. Self-attention was coded from here. You can run the code by running the following command:
python3 model_with_self_attn.py

About

Encoding human activity by considering salient sensors and time points.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages