Automatic Irish Sign Language Recognition

18th October 2018

Proposed by: Sebastian Lutz, Tejo Chalasani, Koustav Ghosal

CNN for gesture recognition has been applied for American Sign Language extensively. There has been some effort and research for doing automatic Irish Sign Language(ISL) detection [1], which looks into applying techniques like SVM, PCA, HMMs for ISL recognition. However applying deep learning for ISL hasn’t been researched to our knowledge. With the advent of good gesture recognition architectures in deep learning, it would be a good idea to apply the existing models to Irish Sign Language recognition. The aim of this project is to

  1. Understand Deep Learning Concepts
  2. Look into existing Gesture Recognition Models
  3. Learn tools like Caffe/TensorFlow/PyTorch.
  4. Collect Training and Testing Data for Irish Sign Language
    1. Getting the existing dataset from [1]
    2. Creating a dataset with help of the Irish Sign Language Club. Are the two options the student can explore in addition to any other ideas he/she can come up with.
  5. Applying the existing models to Irish Sign Language, and potentially publish results in the Irish Computer Vision Conference along with the dataset if created.

References:[1] http://eprints.maynoothuniversity.ie/2437/1/Daniel_Kelly_PhdThesis.pdf

CategoryCompleted