Vision-Enhanced ASL: Promoting Accessibility through VisionOS
Vision-Enhanced ASL: Promoting Accessibility through VisionOS
Accessibility enhancement for the Vision Pro platform. This initiative is geared towards individuals facing challenges with hearing impairment.
Getting Started
Gestures
I integrated a familiar gesture recognized by the Vision Pro with a subtle modification, transforming it into the emblem for the "sign language mode." The hand gestures prominently symbolize sign language as well.
I integrated a familiar gesture recognized by the Vision Pro with a subtle modification, transforming it into the emblem for the "sign language mode." The hand gestures prominently symbolize sign language as well.
Gestures
Getting Started
ASL Siri Integration
ASL Siri Integration
Activating ASL Communication with Siri
Activating ASL Communication with Siri
"Hey" in ASL
"Hey" in ASL
"Hey" in ASL
ASL to Text
Clicking
Clicking
Clicking
Clicking
I integrated a familiar gesture recognized by the Vision Pro with a subtle modification, transforming it into the emblem for the "sign language mode." The hand gestures prominently symbolize sign language as well.
Getting Started
Gestures
I integrated a familiar gesture recognized by the Vision Pro with a subtle modification, transforming it into the emblem for the "sign language mode." The hand gestures prominently symbolize sign language as well.
Gestures
Getting Started
Gestures
I integrated a familiar gesture recognized by the Vision Pro with a subtle modification, transforming it into the emblem for the "sign language mode." The hand gestures prominently symbolize sign language as well.
Getting Started
Gestures
I integrated a familiar gesture recognized by the Vision Pro with a subtle modification, transforming it into the emblem for the "sign language mode." The hand gestures prominently symbolize sign language as well.
"Hey" in ASL
The Interactions
Setting up
ASL to text
Users will have the option to configure this implementation on 'settings,' enabling an extra 360-degree hand scan for improved recognition of sign language from various capture angles.
The Interactions
Setting up
ASL to text
Users will have the option to configure this implementation on 'settings,' enabling an extra 360-degree hand scan for improved recognition of sign language from various capture angles.
ASL to text
Setting up
Users will have the option to configure this implementation on 'settings,' enabling an extra 360-degree hand scan for improved recognition of sign language from various capture angles.
How it works
Using Vision-based sign language recognition (SLR) and training the sign language dataset via cloudKit makes text translation from sign language recognition achievable.
How it works
How it works
Using Vision-based sign language recognition (SLR) and training the sign language dataset via cloudKit makes text translation from sign language recognition achievable.
User Flow - Sign Language (ASL) to text
User Flow - Sign Language (ASL) to text
User Flow - Sign Language (ASL) to text
User Flow - Sign Language (ASL) to text
User Flow - Sign Language (ASL) to text
User Flow - Sign Language (ASL) to text
Communication
Communication
Be in the moment. Without restrictions.
Communication
Be in the moment. Without restrictions.
Live-time ASL to text translation
Apple Vision Pro seamlessly integrates the SLR system into FaceTime and all Apple platforms, offering built-in speech-to-text functionality and now enabling ASL-to-text conversion.
Live-time ASL to text translation
Live-time ASL to text translation
Live-time ASL to text translation
Apple Vision Pro seamlessly integrates the SLR system into FaceTime and all Apple platforms, offering built-in speech-to-text functionality and now enabling ASL-to-text conversion.
Your emotions
come alive
Utilizing the implemented trained model capable of recognizing sign language and facial expressions, we introduce spatial implementations of the original FaceTime gestures, allowing for reactions to be triggered in real-time.
Your emotions
come alive
Utilizing the implemented trained model capable of recognizing sign language and facial expressions, we introduce spatial implementations of the original FaceTime gestures, allowing for reactions to be triggered in real-time.
Productivity
Get on the same page. In the same space.
Productivity
Accessibility | Siri
Setting up
ASL to text
Users will have the option to configure this implementation on 'settings,' enabling an extra 360-degree hand scan for improved recognition of sign language from various capture angles.
Accessibility | Siri
Setting up
ASL to text
Users will have the option to configure this implementation on 'settings,' enabling an extra 360-degree hand scan for improved recognition of sign language from various capture angles.
Accessibility | Siri
Setting up
ASL to text
Users will have the option to configure this implementation on 'settings,' enabling an extra 360-degree hand scan for improved recognition of sign language from various capture angles.
ASL to text
Setting up
Users will have the option to configure this implementation on 'settings,' enabling an extra 360-degree hand scan for improved recognition of sign language from various capture angles.
Get on the same page. In the same space.
Get on the same page. In the same space.
Siri activated through "Hey Siri" trigger motion
Siri comprehending ASL for "What is the weather like today?"
Siri activated through "Hey Siri" trigger motion
Siri comprehending ASL for "What is the weather like today?"
Productivity enhanced with Siri.
Users will have the option to configure this implementation on 'settings,' enabling an extra 360-degree hand scan for improved recognition of sign language from various capture angles.
Users will have the option to configure this implementation on 'settings,' enabling an extra 360-degree hand scan for improved recognition of sign language from various capture angles.
Productivity enhanced with Siri.
Productivity enhanced with Siri.
Productivity enhanced with Siri.
Users will have the option to configure this implementation on 'settings,' enabling an extra 360-degree hand scan for improved recognition of sign language from various capture angles.
Design
Design
Living in your space.
Living in your space.
