Assistivity
Assistivity
Assistivity
Duration
Jan 2025 - Present
Stakeholders
ASSETS 2025,
Dr. JooYoung Seo
Team
Kenneth Ge, Cofounder
Priscilla Zhang, Cofounder
My Role
I led across all aspects of the Assistivity project, from interface design and development to preliminary research. I collaborated with Kenny and Priscilla on conducting user research, creating prototypes, and co-authoring a paper. I led team design sessions to brainstorm and iterate on interface ideas, helped implement the voice-powered workspace, and supported refining the user experience based on early feedback.
Skills
UI/UX Design
UX Research
Front-End Development
Voice Interface Design
Prototyping & Iteration
Usability Testing
Qualitative Research
Cross-Functional Collaboration
Design Facilitation
Tools
Figma
Svelte
JavaScript
HTML/CSS
Zoom Meeting
Google Suite
Github
Overleaf
Duration
Jan 2025 - Present
Stakeholders
ASSETS 2025,
Dr. JooYoung Seo
Team
Kenneth Ge, Cofounder
Priscilla Zhang, Cofounder
My Role
I led across all aspects of the Assistivity project, from interface design and development to preliminary research. I collaborated with Kenny and Priscilla on conducting user research, creating prototypes, and co-authoring a paper. I led team design sessions to brainstorm and iterate on interface ideas, helped implement the voice-powered workspace, and supported refining the user experience based on early feedback.
Skills
UI/UX Design
UX Research
Front-End Development
Voice Interface Design
Prototyping & Iteration
Usability Testing
Qualitative Research
Cross-Functional Collaboration
Design Facilitation
Tools
Figma
Svelte
JavaScript
HTML/CSS
Zoom Meeting
Google Suite
Github
Overleaf
Duration
Jan 2025 - Present
Stakeholders
ASSETS 2025,
Dr. JooYoung Seo
Team
Kenneth Ge, Cofounder
Priscilla Zhang, Cofounder
My Role
I led across all aspects of the Assistivity project, from interface design and development to preliminary research. I collaborated with Kenny and Priscilla on conducting user research, creating prototypes, and co-authoring a paper. I led team design sessions to brainstorm and iterate on interface ideas, helped implement the voice-powered workspace, and supported refining the user experience based on early feedback.
Skills
UI/UX Design
UX Research
Front-End Development
Voice Interface Design
Prototyping & Iteration
Usability Testing
Qualitative Research
Cross-Functional Collaboration
Design Facilitation
Tools
Figma
Svelte
JavaScript
HTML/CSS
Zoom Meeting
Google Suite
Github
Overleaf
Overview
Overview
Overview
About
DESCRIPTION
We created a voice powered math workspace designed for individuals with fine-motor disabilities. The workspace allows direct dictation of math symbols and provides a visual network of connected math relationships. Live Beta Public!
Product Vision
DESCRIPTION
We want to make math accessible for individuals with fine-motor disabilities and provide a new medium for everyone to engage with math. We believe a voice engagement with math will inspire a deeper understanding of mathematics, which focuses less on input mechanics and more on conceptual understanding.
Product Vision
DESCRIPTION
We want to make math accessible for individuals with fine-motor disabilities and provide a new medium for everyone to engage with math. We believe a voice engagement with math will inspire a deeper understanding of mathematics, which focuses less on input mechanics and more on conceptual understanding.
Product Vision
DESCRIPTION
We want to make math accessible for individuals with fine-motor disabilities and provide a new medium for everyone to engage with math. We believe a voice engagement with math will inspire a deeper understanding of mathematics, which focuses less on input mechanics and more on conceptual understanding.
Solution
A voice-powered math tool designed to make problem-solving accessible for users with limited mobility.
Solution
A voice-powered math tool designed to make problem-solving accessible for users with limited mobility.
Solution
A voice-powered math tool designed to make problem-solving accessible for users with limited mobility.
Context
Context
Problem
DESCRIPTION
Students with mobility disabilities lack flexible math assistive tools, and current options are rigid and hard to integrate into their workflows.
Opportunity
DESCRIPTION
AI advancements enable seamless voice-based math tools that integrate naturally into students’ workflows, offering an intuitive and empowering alternative to rigid existing solutions.
Problem
DESCRIPTION
Students with mobility disabilities lack flexible math assistive tools, and current options are rigid and hard to integrate into their workflows.
Opportunity
DESCRIPTION
AI advancements enable seamless voice-based math tools that integrate naturally into students’ workflows, offering an intuitive and empowering alternative to rigid existing solutions.
Challenge
How might we empower students with fine motor disabilities to express their Math knowledge without physical limitations?
Challenge
How might we empower students with fine motor disabilities to express their Math knowledge without physical limitations?
Research
Research
Framing the Problem
DESCRIPTION
I reviewed academic and non-academic literature to understand the target audience, focusing on both math-specific challenges and the broader experiences of people with fine motor disabilities. Key insights from this research are highlighted below.
Framing the Problem
DESCRIPTION
I reviewed academic and non-academic literature to understand the target audience, focusing on both math-specific challenges and the broader experiences of people with fine motor disabilities. Key insights from this research are highlighted below.
Understaffed and Under-Resourced
Disability service providers report lacking staff and resources to fully support students.
Limited funding and institutional barriers hinder personalized outreach and access to assistive technology or mentorship [5].
Alignment and Comprehension
Understaffed and Under-Resourced
Disability service providers report lacking staff and resources to fully support students.
Limited funding and institutional barriers hinder personalized outreach and access to assistive technology or mentorship [5].
Alignment and Comprehension
Understaffed and Under-Resourced
Disability service providers report lacking staff and resources to fully support students.
Limited funding and institutional barriers hinder personalized outreach and access to assistive technology or mentorship [5].
Alignment and Comprehension
Navigating Accessibility Gaps
DESCRIPTION
Gaps in tools, services, and support often leave students with disabilities to take the lead in finding what works. Many develop proactive strategies, advocating for themselves and adapting resources to meet their needs.
Navigating Accessibility Gaps
DESCRIPTION
Gaps in tools, services, and support often leave students with disabilities to take the lead in finding what works. Many develop proactive strategies, advocating for themselves and adapting resources to meet their needs.
Discovery
Discovery
System gaps force students with disabilities to become their own problem-solvers.
System gaps force students with disabilities to become their own problem-solvers.
Discovery
Discovery
Students patch together multiple tools, but seek a simple solution with minimal learning curve.
Students patch together multiple tools, but seek a simple solution with minimal learning curve.
Competitive Landscape: Math Accessibility Tools
DESCRIPTION
To understand what students currently rely on, I reviewed existing solutions and emerging generative AI tools in the accessibility space. The analysis revealed three categories: traditional speech-based math editors, AI-powered tutoring bots, and integrated browser plugins.
Competitive Landscape: Math Accessibility Tools
DESCRIPTION
To understand what students currently rely on, I reviewed existing solutions and emerging generative AI tools in the accessibility space. The analysis revealed three categories: traditional speech-based math editors, AI-powered tutoring bots, and integrated browser plugins.
Flexible Math Expression
DESCRIPTION
Existing tools are rigid, inaccurate, or tutor-focused, making them inaccessible in classroom settings.
Flexible Math Expression
DESCRIPTION
Existing tools are rigid, inaccurate, or tutor-focused, making them inaccessible in classroom settings.
Opportunity
Opportunity
Design a low-barrier math tool that integrates seamlessly into workflows, giving students flexibility and independence now.
Design a low-barrier math tool that integrates seamlessly into workflows, giving students flexibility and independence now.
Understanding Users Through Lived Experience
DESCRIPTION
Building on insights from secondary research and competitive analysis, I turned to lived experiences to ground my design process. Weekly conversations with a teammate who previously experienced severe wrist pain informed my empathy map and guided early design decisions. Link for full empathy map.
Understanding Users Through Lived Experience
DESCRIPTION
Building on insights from secondary research and competitive analysis, I turned to lived experiences to ground my design process. Weekly conversations with a teammate who previously experienced severe wrist pain informed my empathy map and guided early design decisions. Link for full empathy map.
User Snapshot
DESCRIPTION
I translated these findings into a persona to help teammates better understand, synthesize the research, and empathize with students. This is a preview, view the full persona.
User Snapshot
DESCRIPTION
I translated these findings into a persona to help teammates better understand, synthesize the research, and empathize with students. This is a preview, view the full persona.
Ideation
Ideation
From Insights to Ideas
To transition from research to design, we first brainstormed across modalities (AR/spatial, wearables, hardware, voice). While AR and wearables offered novelty, they added complexity, steep learning curves, or lacked classroom accessibility. Voice input emerged as the most practical and inclusive path.
From Insights to Ideas
To transition from research to design, we first brainstormed across modalities (AR/spatial, wearables, hardware, voice). While AR and wearables offered novelty, they added complexity, steep learning curves, or lacked classroom accessibility. Voice input emerged as the most practical and inclusive path.
We then created an affinity map focused on voice input, surfacing key themes around learning curve reduction, workflow integration, and feedback, which guided our design priorities.
We then created an affinity map focused on voice input, surfacing key themes around learning curve reduction, workflow integration, and feedback, which guided our design priorities.
Mapping the Student Homework Journey
I mapped the end-to-end experience of a student completing math homework to uncover pain points and opportunities. This journey highlighted where existing tools fall short and where new solutions could better support independence and accessibility.
Mapping the Student Homework Journey
I mapped the end-to-end experience of a student completing math homework to uncover pain points and opportunities. This journey highlighted where existing tools fall short and where new solutions could better support independence and accessibility.
Defining Design Goals
Bringing together insights from research, competitive analysis, and lived experiences, I distilled four key goals to guide the design of the math authoring tool:
Defining Design Goals
Bringing together insights from research, competitive analysis, and lived experiences, I distilled four key goals to guide the design of the math authoring tool:
Wireframing
Wireframing
Early Wireframe: Building the Foundation for Voice Input
The first wireframe focused on creating a simple, low-barrier flow for authoring math expressions through voice input, setting the stage for accessible interaction design.
Early Wireframe: Building the Foundation for Voice Input
The first wireframe focused on creating a simple, low-barrier flow for authoring math expressions through voice input, setting the stage for accessible interaction design.
The following illustrates how someone can add math expressions step by step.
The following illustrates how someone can add math expressions step by step.
From Interaction to Workspace
While the early wireframes focused on voice input, the next step was to design a complete workspace that put the four design goals into action. This meant creating a space where students could dictate, edit, and organize math expressions seamlessly, supporting not just input, but the entire process of solving and presenting math.
From Interaction to Workspace
While the early wireframes focused on voice input, the next step was to design a complete workspace that put the four design goals into action. This meant creating a space where students could dictate, edit, and organize math expressions seamlessly, supporting not just input, but the entire process of solving and presenting math.
Key Considerations
Key Considerations
Updating the Math Input UI
While the original math UI design provided a starting point, it lacked cohesion for a full workspace. The iteration focused on making expressions easier to create and review once added.
Updating the Math Input UI
While the original math UI design provided a starting point, it lacked cohesion for a full workspace. The iteration focused on making expressions easier to create and review once added.
Step-by-Step Problem Flow
Another key consideration was creating visual connections between expressions to clarify dependencies between equations and help users build confidence while navigating complex calculations.
Step-by-Step Problem Flow
Another key consideration was creating visual connections between expressions to clarify dependencies between equations and help users build confidence while navigating complex calculations.
Workspace
I explored sidebar, tabs, and popup options. The sidebar was chosen for its familiarity, low learning curve, and ability to keep students in flow while switching or adding boards.
Workspace
I explored sidebar, tabs, and popup options. The sidebar was chosen for its familiarity, low learning curve, and ability to keep students in flow while switching or adding boards.
🚀 Try the Open Beta
Our workspace is live in an open beta. Students can explore dictation, flexible editing, and organizing math in a free-form canvas.
🚀 Try the Open Beta
Our workspace is live in an open beta. Students can explore dictation, flexible editing, and organizing math in a free-form canvas.
Public Beta Live 🎉
View Assistivity
Listening & Learning
We’re actively interviewing math professors and students with fine motor disabilities to guide our design. Thirteen interviews are complete, with more ongoing, as we continue testing and iterating. Want to contribute? Join our study below.
Listening & Learning
We’re actively interviewing math professors and students with fine motor disabilities to guide our design. Thirteen interviews are complete, with more ongoing, as we continue testing and iterating. Want to contribute? Join our study below.
We’re conducting interviews with students and educators.
We’re conducting interviews with students and educators.
Get Involved