Live Session
Wednesday Posters
Industry Poster
Leveraging LLM generated labels to reduce bad matches in job recommendations
Yingchi Pei (Indeed.com), Yi Wei Pang (Indeed.com), Nilanjan Sengupta (Indeed.com) and Dheeraj Toshniwal (Indeed.com)
Abstract
Negative signals are increasingly employed to enhance recommendation quality. However, explicit negative feedback is often sparse and may disproportionately reflect the preferences of more vocal users. Commonly used implicit negative feedback, such as impressions without positive interactions, has the limitation of not accurately capturing users' true negative preferences because users mainly pursue information they consider interesting. In this work, we present an approach that leverages fine-tuned Large Language Models (LLMs) to evaluate matches and generate negative signals at scale while maintaining cost efficiency. We demonstrate significant improvements in recommendation quality by deploying a traditional classifier trained using LLM-generated labels.