Preprocess file of the dataset used in implicit sub-populations:
(Demographic groups: race and gender)
The following code will pre-process the jigsaw dataset and return train/test dataset files including demographic groups information.
Download the jigsaw dataset: identity_individual_annotations.csv from
https://www.kaggle.com/c/jigsaw-unintended-bias-in-toxicity-classification/data.
python preprocecss_jiasaw_toxicity_gender_and_race_balanced.py
Please follow the official implementations of MixMatch, MixText, and UDA.
[1] https://github.com/google-research/mixmatch