Transforming Sensor Data to the Image Domain for Deep Learning - an Application to Footstep Detection

Convolutional Neural Networks (CNNs) have become the state-of-the-art in various computer vision tasks, but they are still premature for most sensor data, especially in pervasive and wearable computing. A major reason for this is the limited amount of annotated training data. In this paper, we propose the idea of leveraging the discriminative power of pre-trained deep CNNs on 2-dimensional sensor data by transforming the sensor modality to the visual domain. By three proposed strategies, 2D sensor output is converted into pressure distribution imageries. Then we utilize a pre-trained CNN for transfer learning on the converted imagery data. We evaluate our method on a gait dataset of floor surface pressure mapping. We obtain a classification accuracy of 87.66%, which outperforms the conventional machine learning methods by over 10%.

Project Details

Date: Jan 4, 2017

Author: Monit Shah Singh, Vinaychandran Pondenkandath, Bo Zhou, Paul Lukowicz, Marcus Liwicki

Categories: projectfootstep detectiontransfer learning

Website: https://arxiv.org/abs/1701.01077

Related Works.

Cutting the Error by Half: Investigation of Very Deep CNN and Advanced Training Strategies for Document Image Classification

TAC-GAN - Text Conditioned Auxiliary Classifier Generative Adversarial Network

Multilevel Context Representation for Improving Object Recognition

Music Information Retrieval

Transforming Sensor Data to the Image Domain for Deep Learning - an Application to Footstep Detection

About

We believe that creativity comes with freedom and to solve challenging problems in AI we need to have freedom and creative thinking. We provide an unconstrained environment to highly motivated students to do whatever that comes to their minds and explore deep learning.

Social Links

Our Bunker

Rooms 36-(307/309/310),
TU Kaiserslautern,
Paul-Ehrlich-Str. 36,
67663 Kaiserslautern,
Germany