Papers for

audio streaming services

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Opus audio codec achieves transparent music compression at 160 kbps

Evaluating perceptual transparency of lossy music audio compression with Opus codec

Abstract: Although the open-source Opus audio codec is widely used for digital audio streaming, its perceptual transparency threshold for high-bitrate music compression remains insufficiently evaluated. To establish this threshold, this study evaluates Opus across a two-phase ITU-R BS.1116-3 double-blind framework, analyzing Difference Grades using a Linear Mixed-Effects Model (LMM) and Two One-Sided Tests (TOST) for statistical equivalence. In a first phase with 21 qualified listeners and 23 music excerpts, 128 kbps achieves statistical in-distinguishability ($p = 0.456$) but narrowly fails strict equivalence to the uncompressed reference ($p = 0.064$). In Phase 2, Best Linear Unbiased Predictors (BLUPs) isolate the 10 most critical listeners and 8 most challenging samples for a stress-test. Under these worst-case conditions, 128 kbps is conclusively detected as degraded ($p = 0.030$), whereas 160 kbps successfully reaches perceptual transparency ($p = 0.747$) and strict statistical equivalence ($p = 0.024$). The study concludes that 160 kbps demonstrates perceptual transparency to uncompressed CD quality in critical listening environments. For reproducibility, we publicly release results for both phases, anonymized subject background info and sample characteristics.

Wed 14 OctSound
The gist
This study examines how well the Opus audio codec compresses music without listeners noticing quality loss. At 128 kbps bitrate, most listeners can hardly tell the difference from uncompressed music, but some slight degradation is still detected under tough listening tests. Increasing the bitrate to 160 kbps makes the compressed music indistinguishable from original CD-quality sound, even for critical listeners and challenging music samples. The researchers tested this with many listeners and different songs, and they share their data for others to check.
Open → 2610.20246v1

Benchmarking watermarks and fingerprints for image audio and video provenance

Watermarks and Fingerprints as Soft Bindings for Content Provenance: An Open-Licence Benchmark for Images, Audio and Video

Abstract: Content-provenance standards such as C2PA let a platform recover a stripped manifest through a soft binding: an invisible watermark read from the content, or a fingerprint looked up in a registry. We benchmarked both families under one protocol, restricted to openly available models whose licences we audited, on public media, with false-match rates calibrated on held-out negatives and source-level bootstrap intervals for performance estimates. For watermarking we evaluated 25 image, 7 audio and 7 video configurations from 12 methods on perceptual quality, robustness, false positives and cost; for fingerprinting, 35 methods on registries of up to 98,985 images, partial edits and adversarial attacks. PixelSeal gave the best balance for image and video watermarks and AudioSeal for audio, but the error-correcting detector of every TrustMark variant fired on 5.9 to 15.3% of unmarked images, so a verifier should test the expected payload. Among fingerprints, copy detectors trained on non-commercial data detected up to 75.5% of transformed images at a pair-level false-match rate of $10^{-7}$ and DINOv2, the best permissively licensed method, 65.0%; near-copies in a product catalogue dominated the false matches, and no detection improvement from geometric verification was observed under a matched calibration false-binding constraint in the evaluated image pipelines. On the same attacked copies the two families failed differently: the union of watermark and fingerprint successes covered 69% of image copies; fingerprints covered more audio queries, whereas expected-key watermark verification covered more video queries. Embedding a watermark moved the ISCC code of 62.0% of images past its match threshold, and platform-dependent colour conversion changed watermark bits between x86 and ARM hosts.

Fri 2 OctComputer Vision and Pattern Recognition
The gist
It is often important to verify where digital images, audio, or videos come from, especially if some key information has been removed. This paper compares two common ways to do this: invisible watermarks embedded in the content, and fingerprints that identify content by its unique features. The authors tested many open-licensed methods on public media and found some approaches that work better than others, noting strengths and weaknesses for different media types. Their results help understand which methods detect altered or copied content more reliably.
Open → 2610.04151v1

Transformers improve audio quality by restoring missing high frequencies

Multi-Rate Bandwidth Extension by Token Completion in Neural Audio Codecs

Abstract: Bandwidth extension, the task of reconstructing the high-frequency components of an audio signal from its low-passed counterpart, is a long-standing problem in audio processing. In this work, we extend recent advances in neural architectures by framing bandwidth extension as an audio token prediction problem. Specifically, we train a transformer-based language model on the discrete representations produced by a disentangled neural audio codec, where the disentanglement is guided by a Harmonic-Percussive decomposition of the input signals, highlighting spectral structures particularly relevant for bandwidth extension. Our approach introduces a novel codec design that explicitly accounts for the downstream token prediction task, enabling a more effective coupling between codec structure and transformer modeling. This joint design yields high-quality reconstructions of the original signal, as measured by both objective metrics and subjective evaluations. These results highlight the importance of aligning codec disentanglement and representation learning with the generative modeling stage, and demonstrate the potential of global, representation-aware design for advancing bandwidth extension.

Tue 29 SeptSound
The gist
Sounds often lose their high-pitched details when compressed or transmitted, making them less clear. The authors view this as a puzzle where a computer predicts the missing sound pieces using a transformer, a type of AI model. They designed a new sound encoding system that helps the AI better guess these missing parts. This approach results in clearer sounds that people and machines agree are better. It shows that designing the sound encoding and AI prediction together leads to improved audio restoration.
Open → 2609.38502v1