Kendall's tau
A statistical metric measuring the rank correlation between two ranked variables, widely used to evaluate ranking consistency.
Timeline (last 90 days)
Ranking consistency is a metric in recommender systems and information retrieval for measuring ranking quality, commonly quantified using Kendall's tau or the Spearman rank correlation coefficient, comparing the degree to which the pairwise orderings of the model's ranking and the true observed ranking agree.
Kendall's tau measures the agreement between two rankings and ranges from -1 to 1; with small samples the sampling fluctuation is large—for nine models (36 pairs), tau=0.61 has a standard error of about 0.12 and a 95% confidence interval of roughly 0.37 to 0.85; tau reflects only overall monotonic association and is insensitive to local swaps.
All Facts (2)
Ranking consistency is a metric in recommender systems and information retrieval for measuring ranking quality, commonly quantified using Kendall's tau or the Spearman rank correlation coefficient, comparing the degree to which the pairwise orderings of the model's ranking and the true observed ranking agree.
50%UnverifiedKendall's tau measures the agreement between two rankings and ranges from -1 to 1; with small samples the sampling fluctuation is large—for nine models (36 pairs), tau=0.61 has a standard error of about 0.12 and a 95% confidence interval of roughly 0.37 to 0.85; tau reflects only overall monotonic association and is insensitive to local swaps.
50%