Matthew Sherwood, blind for over 15 years, juggles family life, a successful investing career, and relies on his guide dog, Chris, for navigation. Despite his achievements, everyday tasks like shopping remain challenging without assistance.
Traditionally, Sherwood has used the Be My Eyes app, connecting him with sighted volunteers via live video for tasks such as identifying clothing colors or checking expiration dates on groceries. However, advancements in AI technology are promising newfound independence.
In a groundbreaking partnership with OpenAI, Be My Eyes integrated AI capabilities to describe surroundings in real-time, reducing reliance on human volunteers. OpenAI’s demo showcased a user successfully hailing a taxi, guided precisely by the AI-powered app. Similarly, Google recently introduced comparable AI features in its “Lookout” app, aimed at aiding visually impaired users.
Major tech giants like Apple and Google have introduced a range of AI-driven tools designed to enhance the lives of people facing various challenges. These innovations include eye-tracking technology that allows physically disabled users to control their iPhones and detailed voice guidance on Google Maps for blind users.
Since the impressive launch of ChatGPT over a year ago, it’s become evident that AI is reshaping our world, transforming how we work, communicate, and perceive reality. However, for individuals with disabilities, AI represents a potential life-changing opportunity of a different magnitude.
Matthew Sherwood highlights this transformative potential: “In the past, blind individuals in business often relied on administrative assistants to read for them. Now, with AI, there’s a new level of empowerment… This technology isn’t just great; it’s an opportunity for blind individuals to gain employment, compete in business, and achieve success.
The Advantages of AI in Enhancing Accessibility
Over the years, tech companies have integrated early AI technologies into their products to enhance accessibility, such as automated closed captioning and screen readers. However, recent advancements in AI, driven by extensive datasets and powerful computing systems, are dramatically expanding possibilities in assistive technology.
For instance, developing AI tools that reliably assist blind individuals in hailing taxis requires sophisticated image recognition capabilities, which are refined through extensive training on vast datasets. Similarly, Google has enhanced its tool for blind and low-vision users by integrating generative AI technology, introducing features like a “question and answer” function to further improve accessibility.
Eve Andersson, Google’s senior director of product inclusion, equity, and accessibility, emphasized that while the promise of AI has been recognized for years, its recent advancements in quality are pivotal for integration into products. Generative AI tools are particularly promising in accessibility applications because they excel in understanding and generating information in diverse formats like text, audio, photos, and videos. This versatility enables AI to serve as a bridge, converting, for example, audio content into written text for users with hearing impairments.
Andersson pointed out, “Accessibility needs vary widely, but many disabilities involve how individuals perceive information—whether it’s related to hearing, vision, motor skills, speech, or cognitive abilities. AI excels in translating between different modes of information, making it invaluable for addressing these diverse needs.”
Creating AI Systems that Foster Inclusivity
Ongoing investment is crucial to ensuring that AI systems effectively cater to diverse user needs. Given that AI models learn from human-generated data, concerns have been raised about their potential to perpetuate biases observed in society. Early instances have highlighted issues such as AI image generators struggling with racial concepts or algorithms displaying gender-biassed job advertisements.
To mitigate these risks, a coalition of major tech companies including Apple, Google, and Microsoft, has collaborated with researchers at the University of Illinois Urbana-Champaign. Together, they are developing a comprehensive training dataset for AI speech recognition tools that encompasses a wide range of speech patterns. This initiative, known as the Speech Accessibility Project, involves gathering recordings from volunteers affected by conditions like Parkinson’s, Down Syndrome, and ALS, which can impact speech.
Through this effort, which has amassed over 200,000 recordings to date, researchers have enhanced the accuracy of a sample speech recognition tool. Initially prone to misunderstanding speech 20% of the time, it now does so only 12% of the time following training on the diverse dataset. This progress underscores the importance of inclusive data practices in developing AI technologies that serve all users effectively.
Clarion Mendes, a speech language pathologist and clinical assistant professor leading the project, underscores the importance of incorporating diverse speech patterns into machine learning systems. According to Mendes, this inclusivity is crucial for improving the systems’ ability to understand individuals beyond those with standard speech patterns typically found in audiobooks.
Mendes also highlights the profound impact of assistive technology on individuals facing communication barriers, noting that many highly qualified individuals struggle to secure employment due to these challenges. Assistive technologies can significantly enhance independence by reducing reliance on others and streamlining tasks, thereby enabling individuals to engage more fully in hobbies and professional endeavours.
Eve Andersson further emphasises the business rationale behind investing in AI for accessibility, noting that inclusivity not only aligns with ethical imperatives but also opens up opportunities to serve diverse markets, including government and educational institutions. She stresses that technology has the potential to level the playing field, ensuring that everyone can benefit from its advancements.