Training Deep Pitch-Class Representations With a Multi-Label CTC Loss - Equipe Signal, Statistique et Apprentissage Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Training Deep Pitch-Class Representations With a Multi-Label CTC Loss

Résumé

Despite the success of end-to-end approaches, chroma (or pitch-class) features remain a useful mid-level representation of music audio recordings due to their direct interpretability. Since traditional chroma variants obtained with signal processing suffer from timbral artifacts such as overtones or vibrato, they do not directly reflect the pitch classes notated in the score. For this reason, training a chroma representation using deep learning ("deep chroma") has become an interesting strategy. Existing approaches involve the use of supervised learning with strongly aligned labels for which, however, only few datasets are available. Recently, the Connectionist Temporal Classification (CTC) loss, initially proposed for speech, has been adopted to learn monophonic (single-label) pitch-class features using weakly aligned labels based on corresponding score--audio segment pairs. To exploit this strategy for the polyphonic case, we propose the use of a multi-label variant of this CTC loss, the MCTC, and formalize this loss for the pitch-class scenario. Our experiments demonstrate that the weakly aligned approach achieves almost equivalent pitch-class estimates than training with strongly aligned annotations. We then study the sensitivity of our approach to segment duration and mismatch. Finally, we compare the learned features with other pitch-class representations and demonstrate their use for chord and local key recognition on classical music datasets.
Fichier principal
Vignette du fichier
WeissP21_PitchClassMCTC_ISMIR.pdf (1.95 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03349734 , version 1 (20-09-2021)

Identifiants

  • HAL Id : hal-03349734 , version 1

Citer

Christof Weiss, Geoffroy Peeters. Training Deep Pitch-Class Representations With a Multi-Label CTC Loss. International Society for Music Information Retrieval Conference (ISMIR), Nov 2021, Virtual Event, France. ⟨hal-03349734⟩
354 Consultations
317 Téléchargements

Partager

Gmail Facebook X LinkedIn More