Ulster University Logo

Ulster Institutional Repository

A Study of Evaluation Metrics for Recommender Algorithms

Biomedical Sciences Research Institute Computer Science Research Institute Environmental Sciences Research Institute Nanotechnology & Advanced Materials Research Institute

Redpath, Jennifer, Shapcott, CM, McClean, SI and Chen, Liming (2008) A Study of Evaluation Metrics for Recommender Algorithms. In: The 19th Irish Conference on Artificial Intelligence and Cognitive Science. Irish AI society. 10 pp. [Conference contribution]

Full text not available from this repository.


There are inherent problems with evaluating the accuracy of recommender systems. Commonly-used metrics for recommender systems depend on the number of recommendations produced and the number of hidden items withheld, making it difficult to directly compare one system with another. In this paper we compare recommender algorithms using two datasets; the standard MovieLens set and an e-commerce dataset that has implicit ratings based on browsing behaviour. We introduce a measure that aids in the comparison and show how to compare results with baseline predictions based on random recommendation selections.

Item Type:Conference contribution (Paper)
Faculties and Schools:Faculty of Computing & Engineering
Faculty of Computing & Engineering > School of Computing and Mathematics
Research Institutes and Groups:Computer Science Research Institute
Computer Science Research Institute > Information and Communication Engineering
Computer Science Research Institute > Smart Environments
ID Code:17866
Deposited By:Dr Liming Chen
Deposited On:12 Apr 2011 15:47
Last Modified:12 Apr 2011 15:47

Repository Staff Only: item control page