BERT遇上知识图谱:预训练模型与知识图谱相结合的研究进展

时间:2020-11-07 12:40:24
【文件属性】:
文件名称:BERT遇上知识图谱:预训练模型与知识图谱相结合的研究进展
文件大小:10.7MB
文件格式:ZIP
更新时间:2020-11-07 12:40:24
BERT 知识图谱 随着BERT等预训练模型横空出世,NLP方向迎来了一波革命,预训练模型在各类任务上均取得了惊人的成绩。随着各类预训练任务层出不穷,也有部分研究者考虑如何在BERT这一类模型中引入或者强化知识图谱中包含的信息,进而增强BERT对背景知识或常识信息的编码能力。
【文件预览】:
ERNIE:Enhanced Language Representation with Informative Entities.pdf.pdf
Exploiting Structured Knowledge in Text via Graph-Guided Representation Lear.pdf.pdf
JAKET:Joint Pre-training of Knowledge Graph and Language Understanding.pdf.pdf
KEPLER:A Unified Model for Knowledge Embedding and Pre-trained Language Rep.pdf.pdf
CoLAKE:Contextualized Language and Knowledge Embedding.pdf.pdf
K-ADAPTER:Infusing Knowledge into Pre-Trained Models with Adapters.pdf.pdf
Integrating Graph Contextualized Knowledge into Pre-trained Language Models.pdf.pdf
K-BERT:Enabling Language Representation with Knowledge Graph.pdf.pdf

网友评论