Debias the Black-box: A Fair Ranking Framework via Knowledge Distillation

The initial KD method transfers knowledge through the softmax output of a teacher model. Some subsequent work has extended the scope of statistics used for matching, such as intermediate feature responses [3], gradient [22], and distribution [7], etc. Other work, on the other hand, opted for a more subtle structural design. For example, DE-RRD [8] uses distillation experts to learn the middle layer representation space mapping function of Teacher while additionally using the rank order given by Teacher for rank matching; DCD [12] assigns more training resource to instances that were not correctly predicted by Student; MiniLM [24] proposes an assistant mechanism to distill only the last layer of the self-attentive matrix and the value-value matrix of the pre-trained model. But the potential of KD for other objectives remains largely unexplored.

Despite the growing impact of online information systems on our society and economy, the fairness of rankings has been a relatively under-explored area. In the existing work, some consider the equity of groups with respect to a set of categorical sensitive attributes (or features) to be ranked according to the principle of population parity, which can be further divided into group fairness [9] and individual fairness [15]. But there are other works such as [20, 4] that argue that the fairness of ranking systems corresponds to how they assign exposure based on the merits of individual items or item groups. These works specify and enforce fairness constraints that explicitly link relevance to exposure in expectation or amortized over a set of queries [21].

Ranking distillation attempts to mimic the teacher ranking model by transferring its knowledge to the student. For we only care about the top performers, considering the scores of all query-document pairs is undoubtedly inefficient and wasteful. A straightforward approach is to use only the information of top-$K$ items and discard items ranked low by the teacher like [23]. But this approach leads to performance degradation because some useful information is discarded. It is undesirable to discard directly or incorporate wholesale into the training for candidate items that are not on the teacher model recommendation list.

1). For items recommended by Teacher, student network learns to match all their orders to get fine-grained scoring results.

2). Candidates not recommended by the teacher model are also internally differentiated: items with very low scores do not help maintain a distinct score boundary, and the model should be allowed to learn more information from candidates close to the boundary.

FRD treats Teacher’s top-$K$ candidates as positive set $P$ to help the student imitate top performers’ order and samples out negative set $N$ to keep less relevant documents at lower end. Inspired by [19], two categorical ranking losses $L_P(t,s,P)\text{and}{L}_N(s,P,N)$ are employed to allocate computing resources rationally according to importance, where $t,s\in R^A$ represent the score list generated by Teacher and Student respectively. For the top-K list containing more refined sorting information of $f^T$, we construct a softmax based cross-entropy loss to minimize the difference between student’s and teacher’s top-p lists (positive set $P$). It is worth mentioning that here we relax $K$ to $p$ in Algorithm 1 to give more items recommendation opportunities.

Later, for the large negative sample set, the binary or pairwise comparison loss functions like Equation (2) with less complexity can be employed since we only need to discriminate the rest items without considering the precise ranking. A negative sampling strategy is adopted to further reduce the number of negative candidates. A compressed set $C$ is first sampled out with a categorical distribution $Q$, and then score with the student model to pick the top $n$ documents to form the negative set $N$. This process brings a huge reduction in the calculation amount but no loss of effect.

This categorical distillation strategy helps us concentrate finite computational power on the most useful retrieved list displayed to users while making good use of the remaining items.

It is widely accepted that an item’s position in the rankings has a critical impact on its exposure and financial success. Yet, surprisingly, the algorithms used to learn these rankings are often blind to their impact on items. The key goal of our amelioration is to promote exposure-based fairness during distillation. Based on the exposure estimating approach proposed below, we can explicitly specify how exposure is allocated such as making exposure proportional to relevance.

In recent years, the popularity of the Plackett-Luce (PL) ranking model [14] has increased. It is more efficient to use the PL ranking model to model the probabilistic distribution over rankings directly. Especially for fair distributions of attention exposure, multiple lines of previous works have found that PL ranking models may transfer the deterministic recommendation pattern into reflecting the relevance by the probability of occurrence [20, 4, 21], which gives an approximately equal possibility of being the top-item to candidates with slightly lower relevance indicators.

In the meantime, we follow the definition of exposure-based fairness: the items with higher ranking should achieve more exposure in practical environment. Thus we can constraint the difference between existing arrangement and counterfactual arrangement by minimize their exchanged exposure difference. For brevity we denote ${\epsilon }_d=\epsilon (q,d)$ as the exposure an item $d$ receives under a probabilistic model $\pi$:

where $z$ denotes a possible permutation and rank weight ${\theta }_k$ indicates the probability that a user examines the item at rank $k$ (e.g. $\frac{1}{k}$). For each query, this statistic calculates the averaged disparity between every two items and takes the average disparity across all item pairs:

Here the relevance of a document $R_d$ is set as a transformation of its label and the exposures are estimated by $d$’s total possibly gained rank weight [16] calculated through a continued product of following softmax principle:

where $s\left(d\right)$ denotes the score that the student model assigns to document $d$.

Calculating the gradient of a PL ranking model, on the other hand, necessitates iterating through every conceivable ranking that the model may generate, i.e, every possible permutation. In reality, this computational impossibility is overcome by estimating the gradient using model rankings as samples [17]. Employing the estimator to the gradient of PL model proposed in [16], we can optimize the exposure-based unfairness metrics simultaneously during knowledge distillation. This Metric (4) is designed to measure the difference in reward if the exposures of two items were swapped. Substituting the derivative of this metric with respect to ${\epsilon }_d$, we can employ the below-mentioned estimator [16] to estimate its gradient and then update the PL model by back propagation, $m$ denotes the ranking merit and an entire ranking is sampled with Gumble Softmax [5] trick rather than calculating any of the actual probabilities [1].

In total, the loss of FRD is

where $\lambda$ is the tuning parameter specific to the dataset. This framework is model-agnostic as it only requires the teacher network’s scoring data, making it easy to distill black box models. It is also able to debias ranking models against many attributes as it does not require any side information.

The distillation and fairness performances of teacher and student models on three datasets are presented in Table 1. The student model is a two-layered FC-BN-ReLU model of hidden units of sizes 28, 28. We utilize two kinds of distillation loss, the pairwise and binary loss, shown in methods ending with ‘P’ and ‘B’, respectively.

FRD consistently outperforms RankDistil and the teacher model in fairness. The averaged disparity of FRD methods decreases by 15%~46%, compared with the teacher model. The student models of RankDistil also exhibit a slight improvement in fairness, which is caused by the reduced size of the model. Note that we attribute to the differences unfairness values due to the different composition of the datasets, for example, each query in the Istella test set corresponds to an average of 319 documents, while for the Yahoo dataset, the number is 24. Deeper reasons remain to be explored, but for now, this fairness metric is not applicable to cross-dataset comparisons.

With regards to the ranking performance, student models trained with pairwise loss significantly outperform binary loss. Both RankDistil and FRD with pairwise loss yield similar performances to the teacher model on MSLR Web30K and Yahoo LETOR datasets. On Istella dataset, student models perform significantly worse than the teacher model due to their lack of capacity to capture enough patterns from the huge dataset.

Table 2 displays the performance of pairwise distillation methods on two datasets while varying the size of student models from 50% to 1% of Teacher. We vary the size of student models by adjusting the number of hidden neuron units. Fewer parameters means faster inference.

Both RankDistil and FRD methods with pairwise loss are robust to the size of student models, as the NDCG${}_5$ scores of the 1% student models are comparable to the teachers. FRD can reduce the average squared disparity significantly faster than RankDistil, which indicates that the fairness penalty plays an essential role in alleviating the disparity in ranking. The distillation performance of FRD has some decrease compared to RankDistil, but not more than 0.06%, which is negligible considering the improvement in fair performance.