Live Session
Session 2: Bias and Fairness 1
Reproducibility
Do Recommender Systems Promote Local Music? A Reproducibility Study Using Music Streaming Data
Kristina Matrosova (Deezer Research, CNRS, Geographie-Cités), Lilian Marey (Deezer Research, LTCI, Télécom Paris), Guillaume Salha-Galvan (Deezer Research), Thomas Louail (CNRS, Geographie-Cités), Olivier Bodini (LIPN, Université Sorbonne Paris Nord) and Manuel Moussallam (Deezer Research)
Abstract
This paper examines the influence of recommender systems on local music representation, discussing prior findings from an empirical study on the LFM-2b public dataset. This prior study argued that different recommender systems exhibit algorithmic biases shifting music consumption either towards or against local content. However, LFM-2b users do not reflect the diverse audience of music streaming services. To assess the robustness of this study’s conclusions, we conduct a comparative analysis using proprietary listening data from a global music streaming service, which we publicly release alongside this paper. We observe significant differences in local music consumption patterns between our dataset and LFM-2b, suggesting that caution should be exercised when drawing conclusions on local music based solely on LFM-2b. Moreover, we show that the algorithmic biases exhibited in the original work vary in our dataset, and that several unexplored model parameters can significantly influence these biases and affect the study’s conclusion on both datasets. Finally, we discuss the complexity of accurately labeling local music, emphasizing the risk of misleading conclusions due to unreliable, biased, or incomplete labels.