Live Session
Chamber of Commerce
Poster
17 Oct
 
8:00
CEST
Thursday Posters
Add Session to Calendar 2024-10-17 08:00 am 2024-10-17 05:10 pm Europe/Rome Thursday Posters Thursday Posters is taking place on the RecSys Hub. Https://recsyshub.org
Industry Poster

Bridging the Gap: Unpacking the Hidden Challenges in Knowledge Distillation for Online Ranking Systems

View on ACM Digital Library

Nikhil Khani (Google LLC), Li Wei (Google LLC), Aniruddh Nath (Google LLC), Shawn Andrews (Google LLC), Shuo Yang (Google LLC), Yang Liu (Google LLC) and Pendo Abbo (Google LLC)

View Paper PDFView Poster
Abstract

Knowledge Distillation (KD) is a powerful approach for compressing large models into smaller, more efficient models, particularly beneficial for latency-sensitive applications like recommender systems. However, current KD research predominantly focuses on Computer Vision (CV) and NLP tasks, overlooking unique data characteristics and challenges inherent to recommender systems. This paper addresses these overlooked challenges, specifically: (1) mitigating data distribution shifts between teacher and student models, (2) efficiently identifying optimal teacher configurations within time and budgetary constraints, and (3) enabling computationally efficient and rapid sharing of teacher labels to support multiple students. We present a robust KD system developed and rigorously evaluated on multiple large-scale personalized video recommendation systems within Google. Our live experiment results demonstrate significant improvements in student model performance while ensuring consistent and reliable generation of high-quality teacher labels from continuous data streams.

Join the Conversation

Head to Slido and select the paper's assigned session to join the live discussion.

Conference Agenda

View Full Agenda →
No items found.