How Automatic Speech Recognition Can Help Educators

If you've ever been in a large classroom for a lecture or talk, you've probably experienced struggling to hear the speaker. Even with modern A/V equipment (which isn't present in every classroom), it can still sometimes be hard to hear what a speaker is saying. Now imagine you're not a native speaker of English. Or you have issues with your hearing. Or you have a learning disability that makes it hard to keep up with spoken speech. Paired with poor classroom acoustics, any one of these issues can make it difficult for students to succeed. As a university lecturer, I've encountered all of these problems in the classroom. And it's hard to figure out how best to help students who are struggling with these issues. In this blogpost, I want to review some of the ways that these issues are currently dealt with, and then look at a new solution, powered by automatic speech recognition, that's the best option for creating a classroom that's accessible to everyone.

Current Solutions and Their Problems

I'm not the first person to realize that classroom lectures can present challenges to people from different backgrounds. In this section, I want to review some of the more traditional approaches to classroom accessibility and why they fall short.

Posted Slides and Lecture Notes

One option that's become especially common in recent years is for professors to post their PowerPoint slides for students to review either before or after class. Although this can help, it doesn't address the fact that classes don't always follow the slides directly, and instructors often say other things in class (like answering questions, or reminding students about upcoming assignments).

Class Recordings

Another option is to record lectures, and post them online for students to watch after class. This option has been especially popular during the pandemic, as students may be quarantining and not able to attend in person. But most students don't have time to effectively attend the same class twice. And that's especially true with students who might be having trouble understanding the content or keeping up with coursework, regardless of the reason; asking them to attend every class session twice, while also keeping up on their assignments, simply doesn't work.

In-class Notetaker

One option for students with a documented disability is to have someone else in the class take notes for them-this is usually organized officially through the institution's disability services office, and pays another student in the class, who would be taking notes anyway, to share them with the student in question. This is better than some of the other options discussed. Since the content is coming directly from the lectures, students can use the notes afterwards to help clarify and understand course content. But this isn't available to all students (for example, non-native speakers), and it relies on the student taking notes to get it right. If they misunderstand something or get it wrong, that gets passed on to other students.

An Alternative: Live Class Transcripts

What students need is the ability to revisit the material in a way that makes what happens in the classroom accessible to as many people as possible, and is something that can be used on the fly so that students have help understanding what is happening when it's happening.

Our Senior Developer Advocate Kevin Lewis recently built a tool to transcribe classroom lectures, providing a live, automatically generated transcript to make classroom content more accessible. This method can also help people who have difficulty hearing the speaker, for whatever reason, or keeping track of what's been said and how the lecture is organized. Live transcripts are also useful for non-native speakers, who might hear a word they don't know, but not know how to spell it to look it up (a common problem with English)-and it works either during class from the live transcript, or by reviewing it later.