fine_tuning_transformer_glue

Selecting pre-trained transformer model from Hugging Face zoo and fine-tuning it to a GLUE task. This is in fact a whole family of benchmarks:

f"finetune_transformer_glue_{dataset}": Tune number of hyperparameters for fixed pre-trained model, selected by --model_type
f"finetune_transformer_glue_modsel_{dataset}": Tune the same hyperparameters and select the best pre-trained model from a list of 9 choices

Here, dataset selects the GLUE document classification task (values are “cola”, “mnli”, “mrpc”, “qnli”, “qqp”, “rte”, “sst2”, “stsb”, “wnli”).