BrailleBench: Investigating Multi-Criteria Braille Comprehension in Large Language Models
Provides a novel evaluation framework and findings critical for developing more accessible AI systems for blind and deafblind users.
AI Summary
Researchers introduce BrailleBench, a revealing significant gaps in LLMs' ability to comprehend and generate Braille, particularly for Grade 2 Braille and end-to-end interaction.
Excerpt
Although Large language models (LLMs) mediate access to knowledge and computational assistance, their capabilities should benefit vulnerable groups in the same way. However, it is unclear whether existing AI systems are inclusive enough for blind and deafblind users to access the same functionality through Braille, whose indicators, contractions, and digital representations introduce distinct requirements for model comprehension. To this end, we introduce BrailleBench, a benchmark for evaluating