cs.IR cs.LG
Addressing Class Imbalance Problem in Personalized Ranking. Pairwise ranking models have been widely used to address recommendation problems. The basic idea is to learn the rank of users' preferred items through separating items into emph positive samples if user item interactions exist, and emph negative samples otherwise. Due to the limited number of observable interactions, pairwise ranking models face serious emph class imbalance issues. Our theoretical analysis shows that current sampling based methods cause the vertex level imbalance problem, which makes the norm of learned item embeddings towards infinite after a certain training iterations, and consequently results in vanishing gradient and affects the model inference results. We thus propose an efficient emph underline Vi tal underline N egative underline S ampler (VINS) to alleviate the class imbalance issue for pairwise ranking model, in particular for deep learning models optimized by gradient methods. The core of VINS is a bias sampler with reject probability that will tend to accept a negative candidate with a larger degree weight than the given positive item. Evaluation results on several real datasets demonstrate that the proposed sampling method speeds up the training procedure 30 to 50 for ranking models ranging from shallow to deep, while maintaining and even improving the quality of ranking results in top N item recommendation.