Item-item collaborative filtering


Item-item collaborative filtering, or item-based, or item-to-item, is a form of collaborative filtering for recommender systems based on the similarity between items calculated using people's ratings of those items. Item-item collaborative filtering was invented and used by Amazon.com in 1998. It was first published in an academic conference in 2001.
Earlier collaborative filtering systems based on rating similarity between users had several problems:
  • systems performed poorly when they had many items but comparatively few ratings
  • computing similarities between all pairs of users was expensive
  • user profiles changed quickly and the entire system model had to be recomputed
Item-item models resolve these problems in systems that have more users than items. Item-item models use rating distributions per item, not per user. With more users than items, each item tends to have more ratings than each user, so an item's average rating usually doesn't change quickly. This leads to more stable rating distributions in the model, so the model doesn't have to be rebuilt as often. When users consume and then rate an item, that item's similar items are picked from the existing system model and added to the user's recommendations.

Method

First, the system executes a model-building stage by finding the similarity between all pairs of items. This similarity function can take many forms, such as correlation between ratings or cosine of those rating vectors. As in user-user systems, similarity functions can use normalized ratings.
Second, the system executes a recommendation stage. It uses the most similar items to a user's already-rated items to generate a list of recommendations. Usually this calculation is a weighted sum or linear regression. This form of recommendation is analogous to "people who rate item X highly, like you, also tend to rate item Y highly, and you haven't rated item Y yet, so you should try it".

Results

Item-item collaborative filtering had less error than user-user collaborative filtering. In addition, its less-dynamic model was computed less often and stored in a smaller matrix, so item-item system performance was better than user-user systems.

Example

Consider the following matrix :
UserArticle 1Article 2Article 3
JohnBought itBought itDid not buy
PierreBought itBought itBought it
MaryDid not buyBought itDid not buy

If a user is interested in Article 1, which other item will be suggested to him by a system which is using Amazon's item-to-item algorithm ?
The goal is to propose the user the article with highest cosinus value. This is how we do it :
Firstly, we convert the User-Article matrix into a binary one and we create a simple matrix for each article.
UserArticle 1Article 2Article 3
John110
Pierre111
Mary010

  • A1 =
  • A2 =
  • A3 =
Secondly, we multiply matrix A1 by each matrix in order to find the dot product.
  • A1 * A2 = + + = 2
  • A1 * A3 = + + = 1
Thirdly, we find the norm of each vector.
  • ||A1|| = = = 1.4142
  • ||A2|| = = = 1.7320
  • ||A3|| = = = 1
Fourthly, we calculate the cosine.
  • A1 and A2 = COS = = = = 0.8165
  • A1 and A3 = COS = = = = = 0.7071
'Conclusion: If a user is interested in article 1. The algorithm item-to-item will suggest article 2.'''''