Wednesday, 6 June 2012
Technology that translates sign language into text aims to empower sign language users
The software
application is the first of its kind in the world which can be used on
portable devices and allows users to customize sign language to their own
specific needs.
The technology has the potential to transform how sign language users – from the profoundly deaf to those who have lost hearing in later life – communicate.
Computing scientists at Technabling, a spin-out company of the University of Aberdeen, are behind the technology which aims to bridge the gap between sign language and more standard forms of communication.
One of its main focuses is to help young deaf people gain employment opportunities.
Dr. Ernesto Compatangelo, a lecturer in Computing Science at the University of Aberdeen, and founder and Director of Technabling said:
“The aim of the technology – known as the Portable Sign language Translator (PSLT) - is to empower sign language users by enabling them to overcome the communication challenges they can experience, through portable technology.
“The user signs into a standard camera integrated into a laptop, netbook, Smartphone or other portable device such as a tablet.
“Their signs are immediately translated into text which can be read by the person they are conversing with.
“The intent is to develop an application - an “app” in Smartphone terms - that is easily accessible and could be used on different devices including Smartphones, laptops and PCs.”
The PSLT has the potential to be used with a range of sign languages including British Sign Language (BSL) and Makaton.
The number of people in the UK whose first or preferred language is BSL is estimated to be between 50,000 (Action on Hearing Loss) and 70,000 (British Deaf Association).
BSL is however, a general-purpose language and therefore poses limitations for users, making it impossible for them to easily express certain concepts and terms that are very specific or used only within particular areas of society – for example education and the workplace.
To overcome this, PSLT enables users to personalise sign language to their own individual needs.
Dr. Compatangelo continued: “One of the most innovative and exciting aspects of the technology, is that it allows sign language users to actually develop their own signs for concepts and terms they need to have in their vocabulary, but they may not have been able to express easily when using BSL.
“Whilst the technology has the potential to transform the lives of all sign language users, a key target market has been identified.
“Our research is being funded by the UK Department for Business, Innovation and Skills*with the specific remit to create technology to enhance the lives of deaf people with special emphasis on post 16 learners, i.e., young people who are either in education or training.
“The key intent is to enable sign language users of this age, and beyond, to overcome the communication disadvantage they experience, allowing them to fulfil their education potential and enter the job market.
“The personalised aspect of the technology is crucial to making this happen.
“For example – for a student who is being trained in joinery, there is no sign in BSL which means “dovetail joint”.
“A student using PSLT can create their own sign to mean “dovetail joint” allowing them to communicate easily with their tutor or other students in their class, without the limitations imposed when communicating solely with BSL.”
Sign language users have inputted into the development and testing of the product since its conception.
Technology which translates sign language into text
is being developed by scientists.
The technology has the potential to transform how sign language users – from the profoundly deaf to those who have lost hearing in later life – communicate.
Computing scientists at Technabling, a spin-out company of the University of Aberdeen, are behind the technology which aims to bridge the gap between sign language and more standard forms of communication.
One of its main focuses is to help young deaf people gain employment opportunities.
Dr. Ernesto Compatangelo, a lecturer in Computing Science at the University of Aberdeen, and founder and Director of Technabling said:
“The aim of the technology – known as the Portable Sign language Translator (PSLT) - is to empower sign language users by enabling them to overcome the communication challenges they can experience, through portable technology.
“The user signs into a standard camera integrated into a laptop, netbook, Smartphone or other portable device such as a tablet.
“Their signs are immediately translated into text which can be read by the person they are conversing with.
“The intent is to develop an application - an “app” in Smartphone terms - that is easily accessible and could be used on different devices including Smartphones, laptops and PCs.”
The PSLT has the potential to be used with a range of sign languages including British Sign Language (BSL) and Makaton.
The number of people in the UK whose first or preferred language is BSL is estimated to be between 50,000 (Action on Hearing Loss) and 70,000 (British Deaf Association).
BSL is however, a general-purpose language and therefore poses limitations for users, making it impossible for them to easily express certain concepts and terms that are very specific or used only within particular areas of society – for example education and the workplace.
To overcome this, PSLT enables users to personalise sign language to their own individual needs.
Dr. Compatangelo continued: “One of the most innovative and exciting aspects of the technology, is that it allows sign language users to actually develop their own signs for concepts and terms they need to have in their vocabulary, but they may not have been able to express easily when using BSL.
“Whilst the technology has the potential to transform the lives of all sign language users, a key target market has been identified.
“Our research is being funded by the UK Department for Business, Innovation and Skills*with the specific remit to create technology to enhance the lives of deaf people with special emphasis on post 16 learners, i.e., young people who are either in education or training.
“The key intent is to enable sign language users of this age, and beyond, to overcome the communication disadvantage they experience, allowing them to fulfil their education potential and enter the job market.
“The personalised aspect of the technology is crucial to making this happen.
“For example – for a student who is being trained in joinery, there is no sign in BSL which means “dovetail joint”.
“A student using PSLT can create their own sign to mean “dovetail joint” allowing them to communicate easily with their tutor or other students in their class, without the limitations imposed when communicating solely with BSL.”
Sign language users have inputted into the development and testing of the product since its conception.
Technology which translates sign language into text
is being developed by scientists.
Three Assistive Technologies to Support
Deafness
Portable Sign Language Translator (PSLT) is software that can be installed on a device with a built-in camera, like a smartphone or laptop, and translates signs into text displayed on the screen.
• Speech to Text
• Speech/Text to Video Sign-Language
• Speech/Text to Computer Generated Voice
Once translated, the user can easily:
• Use the built-in Dictionary / Thesaurus to obtain definitions, synonyms and antonyms
• Perform internet searches for more information
iCommunicator supports students in the classroom in the following ways:
• Helps studetns achieve efficient, effective communication.
• Receive equal access to acoustic information (ie. teacher's instructions).
• Strengthen spoken language comprehension.
• Increase Reading and Language Skills.
• Expand Opportunities for Advancement and Success in Education and Employment.
• Enhance Independence And Self-confidence.
Portable Sign Language Translator (PSLT) is software that can be installed on a device with a built-in camera, like a smartphone or laptop, and translates signs into text displayed on the screen.
This software helps
deaf students who are deaf and non-verbal to communicate with classmates and
teachers. The student's signed messages are translated to text and displayed
for the intended recipient to view.
iCommunicator
iCommunicator promotes independent communication for persons
who are deaf or hard-of-hearing and encourages increased literacy by
“translating” English in real time:
• Speech to Text
• Speech/Text to Video Sign-Language
• Speech/Text to Computer Generated Voice
Once translated, the user can easily:
• Use the built-in Dictionary / Thesaurus to obtain definitions, synonyms and antonyms
• Perform internet searches for more information
iCommunicator supports students in the classroom in the following ways:
• Helps studetns achieve efficient, effective communication.
• Receive equal access to acoustic information (ie. teacher's instructions).
• Strengthen spoken language comprehension.
• Increase Reading and Language Skills.
• Expand Opportunities for Advancement and Success in Education and Employment.
• Enhance Independence And Self-confidence.
iMovie (with captions)
iMovie helps you turn
the HD video you shoot on your iOS device into a thrilling trailer or
masterpiece worthy of the red carpet (even if it’s just the one in your living
room). And since iMovie is designed for Multi-Touch, all you have to do is tap,
swipe, and drag to make some movie magic.
Get
iMovie from the App Store for
$4.99
Captioning is available with iMovie. This feature
allows a universal learning experience in classrooms with deaf students. All
students caption their movies and all students are able to have access to the
information.
No comments:
Post a Comment