（五十八）：COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

（五十八）：COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

• Abstract
• 1. Introduction
• 2. Related Work
• 3. Method
• • 3.1. Preliminary
  • 3.2. Pretraining by Correcting and Contrasting
  • • 3.2.1. CORRECTIVE LANGUAGE MODELING
    • 3.2.2. SEQUENCE CONTRASTIVE LEARNING
    • 3.2.3. COCO-LM TRAINING
• 4. Experimental Setup
• 5. Evaluation Results

标签：Contrasting,Pretraining,Language,LM,3.2,COCO,Correcting
来源： https://blog.csdn.net/qq_37486501/article/details/120083401