Select your language:  ukflag    span flag   
Daniel Martinez Capilla personal webpage - Thesis

Sign Language Translator using Microsoft Kinect XBOX 360
A master's thesis for the Erasmus Mundus in Computer Vision and Robotics (VIBOT 5)
by Daniel Martínez Capilla


Master Thesis: Sign language translator using Microsoft Kinect  XBOX 360

Posted by Admin on April 13, 2012

Results

The training set contains a total of 70 different samples, which is the result after adding five samples for each of the 14 signs from the default dictionary. These training samples are executed by the same user at the same position.
A set of test samples executed by four different users that differs in size is built to find the accuracy of the system. For every user, three different samples are collected which results in a total of 168 test samples.

used users

After testing the system for its different configurations and approaches (i.e. which are the most meaningful futures to describe a joint, weight applied to each of the four used joints, and which is the used classifier), the results show that the best configuration of the system reaches an accuracy of 95.24%.


Conclusions


The initial goal has been satisfied since the use of the Microsoft Kinect XBOX 360TM with the combination of the developed descriptor and classifiers has been shown as an efficient way to solve the sign language translation problem.
As a future work, it will be interesting to track the finger positions so that the signs from the dictionary will belong to one of the existing official sign languages.

Daniel Martínez Capilla

Posted by Admin on April 4, 2012

Personal picture
Acces to the option from below to have acces to my CV.

Download

Watch online the presentation of my MSc Thesis

Posted by Admin on June 19, 2012

Dani_vibotDay

Watch online the presentation of my MSc Thesis about Sign Language Translator using Microsoft Kinect XBOX 360 that I gave during the last VIBOT day 2012. Also have a look to the publications and feel free to download the open source code.

READ MORE

How to make working Microsoft Kinect XBOX 360 from scratch

Posted by Admin on April 4, 2012

This tutorial (also included in the final report), tries to make your life easier when trying to set up the Kinect on your laptop. It took me for a while and I think it is interesting to share my experience with you.

Download