FacebookAI/roberta-base is a pre-trained language model based on the RoBERTa architecture developed by the Facebook AI Research Team (FAIR).