Generating and Using Accessible Mathematics on the Web

Generating and Using Accessible Mathematics on the Web Sam Dooley Pearson Assessment sam.dooley@pearson.com Dynamic Online Accessible Math — Online Braille Math http://accessibility.pearson.com/mathex-app/ Braille math is hard!  Blind students need high-quality braille math  Advanced preparation is costly and takes time  Math teachers are often unfamiliar with braille  TVIs are often unfamiliar with math notation Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Braille math software is harder!  Software translation can be problematic  Forward translation takes many steps  Real-time back translation is non-existent  No support for online or classroom use Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Braille math needs to be online! Blind students need: A level playing field for STEM instruction To read and write online braille math To interact with sighted instructors and peers To participate in online learning To participate in online assessment Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Braille math should be math!  Math concepts are independent of notation  Braille math codes capture all math notation  Math software can be independent of notation Blind students only have full access to math if their math is treated the same as printed math Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Dynamic Online Accessible Math — Accessible Equation Editor http://accessibility.pearson.com/mathex-app/ Accessible Equation Editor  Sighted user can create math for a blind user  Blind user can create math for a sighted user  Real-time, two-way braille math translation  Instantaneous interactions with math content  Discoverable braille math encoding rules Generating and Using Accessible Mathematics on the Web 16 Nov 2016 QWERTY Keyboard Input  Math symbols on the keyboard  Other symbols on the buttons  Keyboard cursor navigation  Implicit and explicit selection  Backspace, delete, clear Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Braille Terminal Output  Math output on the screen  Braille output on the screen  Braille output on the terminal  Screen reader support 10 Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Technical objectives  Real-time translation from math into braille  Real-time translation from braille into math  Accessible to both sighted and blind users  Online equation editor software component 17 Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Accessible Online Math! Blind students can have: A level playing field for STEM instruction Tools to read and write online braille math Interaction with sighted instructors and peers Active 18 participation in online activities Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Braille math is math!  Blind students can read the same math  Blind students can write the same math  The math can be shared the same way  The math can be scored the same way Blind students can now have full access to math since their math is the same as printed math 19 Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Dynamic Online Accessible Math — Online Spoken Math Speech output for static math  Browser  MathJax  Presentation MathML  Screen reader  MathPlayer 21 Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Speech output for dynamic math  Speech output for the entire content  Speech output for the input context  Speech output for the input actions  Speech output for keyboard events 22 Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Natural spoken math output  Dynamic math produces more math output  User intervention is even more essential  More output means more math speech modes  Spoken output can reinforce braille output Blind students can have math read for them, and they can read their math for themselves 23 Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Speech input for dynamic math  Dragon Naturally Speaking  Recognizes words from spoken input  Transmits characters to applications  Supports popular software packages 24 Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Custom speech input rules  Custom rules support specific software  Grammar rules recognize spoken phrases  Spoken phrases become character sequences  Character sequences become input tokens  Input tokens invoke editor template rules 25 Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Natural spoken math input  Spoken text recognition needs work for math  Math notations use well-established patterns  Notational patterns support spoken input rules  Spoken input can augment braille input Blind students can read their math to create it, and they can write their math to create it 26 Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Dynamic Online Accessible Math — Online Braille Text Braille codes for text  Uncontracted Braille (Grade 1)  Contracted Braille (Grade 2)  Computer Braille Code (CBC)  English Braille, American Edition (EBAE)  Unified English Braille (UEB) 28 Generating and Using Accessible Mathematics on the Web 16 Nov 2016 User interfaces for text  Plain text editors (Notepad, Emacs)  Word processors (WordPerfect, Word)  Math expression editors (MathType, Wiris)  Worksheets (Scientific Word/Notebook) 29 Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Natural text plus math input  Content MathML to represent math  Simplified HTML to represent text  Braille input/output for textual content  Nemeth Braille input/output for math  Integrated text/math transitions 30 Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Dynamic Online Accessible Math!  Dynamic braille input/output for math  Dynamic speech input/output for math  Dynamic braille input/output for text Blind students can now have full access to math since their math is the same as printed math 31 Generating and Using Accessible Mathematics on the Web 16 Nov 2016 ... symbols on the keyboard  Other symbols on the buttons  Keyboard cursor navigation  Implicit and explicit selection  Backspace, delete, clear Generating and Using Accessible Mathematics on the Web. .. math Generating and Using Accessible Mathematics on the Web 16 Nov 2016 Dynamic Online Accessible Math — Accessible Equation Editor http://accessibility.pearson.com/mathex-app/ Accessible Equation... on new and more advanced AEE functionality  Math expression navigation  Math expression modification  Nemeth Braille discoverability 15 Generating and Using Accessible Mathematics on the Web