New method measures second language pronunciation using native speech data

A Native-Reference Coordinate Geometry for L2 Pronunciation Deviation Using Self-Supervised Speech Models

Computation and Language

Summary

It can be hard to tell how well someone speaks a second language just by listening. The authors created a way to compare a non-native speaker's pronunciation to native speakers using patterns learned by a computer from lots of speech. Their method does not need specially recorded matching sentences or labels. They found that better speakers tend to sound closer to native speech using this approach.

What this means in practice

  • For language learning software developers: Create automated tools that assess pronunciation without needing parallel native and learner recordings or detailed labels.$Commercial implications: This enables scalable commercial pronunciation assessment features in language learning apps without costly data collection.
  • For speech technology engineers: Improve non-native speech processing by measuring deviation from native phone patterns using self-supervised models.

Authors

Tina Raissi, Nhan Phan, Mikko Kurimo

Abstract

Self-supervised speech models encode rich phonetic information, but it remains unclear how to transform this information into interpretable metrics for second-language (L2) pronunciation assessment in spontaneous speech. We propose a native-reference coordinate geometry in which phone-class averages from native speech define a low-dimensional reference subspace, and L2 speech is evaluated by its distance to matching native phone-class coordinates. Unlike prior distance-based approaches, our method does not require parallel recordings with matched linguistic content or dedicated pronunciation labels. Across different self-supervised encoders and modeling choices, the resulting native-reference distances show negative Spearman correlations up to -0.5 with speaking proficiency, indicating that higher-proficiency speakers tend to lie closer to the native-reference space.