Conceptor Debiasing of Word Representations Evaluated on WEAT

Saket Karve, Lyle Ungar, João Sedoc

Bias in word embeddings such as Word2Vec has been widely investigated, and many efforts made to remove such bias. We show how to use conceptors debiasing to post-process both traditional and contextualized word embeddings. Our conceptor debiasing can simultaneously remove racial and gender biases and, unlike standard debiasing methods, can make effect use of heterogeneous lists of biased words. We show that conceptor debiasing diminishes racial and gender bias of word representations as measured using the Word Embedding Association Test (WEAT) of Caliskan et al. (2017).

Knowledge Graph

arrow_drop_up

Comments

Sign up or login to leave a comment