AI: Assisting Those With Disabilities

Advances in artificial intelligence are creating new ways to help those with disabilities, improving accessibility and quality of life.  AI-powered translation allows real-time conversion of text, speech, and sign language, enabling more natural communication for the deaf and blind.  Systems can also summarise text and simplify language for those with reading disabilities.

AI is making devices like smartphones more accessibility devices with features like screen readers, voice commands, and image descriptions.  It can power autonomous wheelchairs and expanding mobility.  Smart home products respond to voice commands increasing independence.

Challenges remain in improving accuracy, safety, and bias before AI is dependable for critical disabilities.  But rapid progress is being made by researchers to address these issues.

New advances in AI are opening up exciting possibilities for helping those with disabilities.  While it is fair to say it is still an emerging technology, AI and generative AI is showing it can make everyday tasks easier, it can improve access to information, and can enhance the quality of life of those with a disability.

Image created using Leonardo.ai

Opening Doors to Communication

One of the most obvious and practical uses of using generative AI is to translate text to speech, speech to text or sign language in real time.  This could be invaluable for those with hearing or sight disabilities, allowing them to follow conversations and participate fully in daily life.  Generative AI can also be used to automate interpreting sign language into speech.  Researchers at the University of Copenhagen have built an AI system that can recognise sign language and generate understandable verbal speech.  Using this technology will allow those who use sign language as their primary communication to talk more naturally with the broader public.

Image created using Leonardo.ai

Beyond translating, generative AI can summarize large volumes of text into concise highlights for those with reading disabilities like dyslexia.  The heavy burden of reading pages can be summarised to the core facts or story.  Microsoft recently showcased an AI technique that reduces reading difficulty for individuals by paraphrasing complex sentences into simpler language.  This has the potential to increase reading comprehension and make consuming information more accessible, remove barriers to written text, with the result of better and more available news, stories, science, and more to everyone of all reading levels.  While Google's Live Transcribe app reverses this process by using AI to generate real-time captioning for in-person conversations, helping those with hearing difficulties to communicate more naturally.

AI-Powered Accessibility

Recently we have experienced advances in using AI to make smartphones and computers more accessible.  AI is powering screen readers, which can speak the on-screen text to enable people with sight difficulties to hear the app, websites, and more.  And voice commands allow hands-free device control for those who can't physically interact with screens or buttons, for sight or mobility reasons.  Or legal reasons in a car!

For sight impaired people, prototype apps using generative AI can describe images or video and provide enhanced audio explanations of any graphical or visual content online.  Social media companies are currently testing ideas to make graphical memes and posts more accessible for blind users through AI-generated descriptions.  This could make browsing and social media much more enjoyable, and more interesting.

Image created using Leonardo.ai

One use of generative AI is to create entirely new forms of art, music and literature (test).  AI image generators, music composers and storytellers are able to give those with disabilities new creative outlets and ways to express themselves, and for others to consumer media in a way they find enjoyable and or educational.  An example is Google's AI tool PoemPortraits that turns a few words into unique poetry portraits, providing an innovative way to share feelings and perspectives.

AI Enhancing Mobility and Independence

Currently AI is being incorporated into mobility devices to make them more autonomous and responsive.  Of course, self-driving cars gain the most media coverage.  But some prototypes of AI-powered wheelchairs can navigate environments, avoid obstacles, and respond to voice commands.  Others are equipped with computer vision to read signs, recognize faces, and aid memory.  University researchers are currently testing self-driving wheelchairs that can be monitored remotely by caregivers.  If this proves successful, this could greatly expand independence and mobility for wheelchair users, especially those with sight or severe physical impairments.

Image created using Leonardo.ai

Importantly, AI is empowering people with disabilities to live more independently.  Those that required caregivers for basic tasks can now rely on AI features built into accessible devices and apps.  Smart home products like Alexa can respond to voice command to make household control normal.  Turning lights on or off, TV control, music and radio control, setting reminders, and calling out for assistance.  Much higher levels of independence can be achieved.

Some Challenges

While promising, there are still challenges to address before generative AI is mainstream.  The technology needs improvement in areas like accuracy and bias to become dependable, especially for critical disabilities like blindness or deafness.  Research is ongoing by many organisations to make AI systems safer, more trustworthy and user-friendly for all.  That said, it feels like a tipping point is fast approaching.

Looking Ahead 

Great progress has already been made but there is room for AI to address additional accessibility challenges.  As clever people expand the capabilities of generative AI, we can expect more breakthroughs in communication, mobility, autonomy, and beyond.  Voice interfaces and predictions will become more human-like and more companion like.  The possibilities ahead are endless!

Related Articles

45229