Learning Rich Representation of Keyphrases from Text Keyphrase Boundary Infilling with Replacement (KBIR) A new pre-training objective Keyphrase...
Knowledge Graph A knowledge graph is a structured representation of facts, consisting of entities, relationships, and semantic descriptions. Property...
bidirectional transformer pre-training objectives: masked language modeling完形填空 token-level next sentence prediction: s判断给出的两个Input sentence是否相邻...