GKnow: Measuring the Entanglement of Gender Bias and Factual Gender

This repository contains GKnow (data folder) and (in the future) the experimental setup and scripts to replicate the results from the accompanying paper.

Data

• full_gknow.json is the full version of GKnow, with +90k prompts
• gknow_train_fem.json and gknow_train_masc.json are the train set used for the experiments presented in the paper (split into feminine and masculine prompts)
• gknow_test_fem.json and gknow_test_masc.json are the test set. These are filtered in the (soon available) ablation script