[NFB-Science] Request for Volunteers: Non-Visual Graphics Exploration for Reading PDF Equations

Rynhardt Kruger rynkruger at gmail.com
Sun Aug 8 22:12:54 UTC 2021


Hi list,

My name is Rynhardt Kruger, and I am a blind PhD candidate at the
university of Stellenbosch in South Africa.

As part of my PhD, I have developed software that allows blind readers
to explore two-dimensional content like diagrams. This software uses a
combination of sound (sonification) and speech to convey the
two-dimensional structure of the content. The sound consists of tones
in which a varying pitch conveys shape information, thereby producing
an audio rendition of graphical content such as lines and curves.
Non-graphical content, such as symbols and textual elements, are read
out by a screen reader. The software can be controlled via the
keyboard, textual commands, and via a touch screen (if available). I
am writing this email to ask for volunteers who might be interested to
take part in a user evaluation of my software. This evaluation will
hopefully form part of my PhD research.

I have to date successfully evaluated my approach with regards to the
reading of graphical shapes like multiple rectangles, triangles, and
circles, as well as emoticons. I'm currently conducting evaluations
where I'm asking candidates to explore mathematical equations in their
two-dimensional print form, as they might appear in an untagged PDF
document.

I would like to point out that my approach is not meant as a
replacement for existing technologies related to equation
accessibility, but rather as a compliment. Although solutions exist to
read equations (for example braille, MathML, and LaTeX source), and to
convert equations from untagged PDF documents into an accessible form
(for example Infty Reader, and most recently MathPics), the hope is
that my approach might offer an additional way for a blind reader to
explore equations. This may offer advantages including allowing an
explore-by-touch representation of equations, verifying the result of
OCR software, and as an option when OCR isn't feasible.

Should you be interested to volunteer as a participant in this
evaluation, I will ask you to use my software to identify two sets of
equations of about six each, using two different exploration modes.
Although previous knowledge of print equations is certainly helpful,
it is not required on your part. Instead, I have prepared a tutorial
which you can use to familiarise yourself with the software and
example equations. The tutorial will walk you through the
identification of several equations and will also introduce the
mathematical symbols and visual elements you will encounter in the
evaluation.

The software runs entirely in a web browser. Therefore, no software
installation on your computer is required. An internet connection is
however required. Data about your use of the software will be
collected during the evaluation, and I will use this information as
part of my research. However, no personal information will be
disseminated or published. The data in my thesis or in any scientific
paper I hope to write will be completely anonymous.

I would be very grateful if you would participate in the evaluation of
my software. However, participation is completely voluntary.
Ultimately, the aim of my research is to make equations and also
figures appearing in PDF documents accessible to blind readers, to
enable them to independently read technical books and research papers.

If you are interested to participate, please send me an email off list
at:

rynkruger at gmail.com

Thank you and regards,

Rynhardt



More information about the NFB-Science mailing list