Title: Combination of temporal neural networks for improved hand gesture classification
Authors: Tewari, Aditya
Taetz, Bertram
Grandidier, Frédéric
Citation: WSCG '2018: short communications proceedings: The 26th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision 2016 in co-operation with EUROGRAPHICS: University of West Bohemia, Plzen, Czech Republic May 28 - June 1 2018, p. 107-114.
Issue Date: 2018
Publisher: Václav Skala - UNION Agency
Document type: konferenční příspěvek
URI: wscg.zcu.cz/WSCG2018/!!_CSRN-2802.pdf
ISBN: 978-80-86943-41-1
ISSN: 2464-4617
Keywords: LSTM;3D konvoluce;neuronová síť;časové znaky;gesta rukou;aplikace pro automobily
Keywords in different language: LSTM;3D convolution;neural network;temporal features;hand gestures;automobile application
Abstract: Low latency detection of human-machine interactions is an important problem. This work proposes faster detection of gestures using a combination of temporal features learnt on block time input and those learnt by contextual information. The results are reported on a standard in-car hand gesture classification challenge dataset. The recurrent neural networks which learn sequential contexts are combined with 3D convolutional neural networks (C3D). We have demonstrated that a design similar to various multi-column networks, which have been successful for image classification and understanding can also improve classification performance on varying length time series. Therefore, a combination of C3D and Long-Short-Term Memory (LSTM) is utilized for classification of hand gestures. On the task of early hand gesture classification, the proposed model outperforms the the C3D model which reports best results on full gestures. It is second best and only slightly less accurate than the best performing method, on the full gesture length.
Rights: © Václav Skala - UNION Agency
Appears in Collections:WSCG '2018: Short Papers Proceedings

Files in This Item:
File Description SizeFormat 
Tewari.pdfPlný text1,39 MBAdobe PDFView/Open

Please use this identifier to cite or link to this item: http://hdl.handle.net/11025/34662

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.