Live Session
Session 12: Optimisation and Evaluation 2
Reproducibility
Context-based Entity Recommendation for Knowledge Workers: Establishing a Benchmark on Real-life Data
Mahta Bakhshizadeh (German Research Center for Artificial Intelligence (DFKI)), Heiko Maus (German Research Center for Artificial Intelligence (DFKI)) and Andreas Dengel (German Research Center for Artificial Intelligence (DFKI))
Abstract
In recent decades, recommender systems have undergone significant advancements, particularly in popular domains like movies, music, and product recommendations. Yet, progress has been notably slower in leveraging these systems for personal information management and knowledge assistance. In addition to challenges that complicate the adoption of recommender systems in this domain (such as privacy concerns, heterogeneous recommendation items, and frequent context switching), a significant barrier to progress in this area has been the absence of a standardized benchmark for researchers to evaluate their approaches. In response to this gap, this paper presents a benchmark built upon a publicly available dataset of real-life knowledge work in context (RLKWiC). This benchmark focuses on evaluating context-based entity recommendation, a use case for leveraging recommender systems to support knowledge workers in their daily digital tasks. By providing this benchmark, it is aimed to facilitate and accelerate research efforts in enhancing personal knowledge assistance through recommender systems.