BertGCN Transductive Text Classification by Combining GCN and BERT

origin paper： https://arxiv.org/abs/2105.05727

ori code git： https://github.com/ZeroRin/BertGCN

官方知乎： https://zhuanlan.zhihu.com/p/378798855

TextGCN： https://arxiv.org/abs/1809.05679

图结构

we construct a heterogeneous graph containing both word nodes and document nodes following TextGCN. 如下图

node ：word nodes and document nodes

edge ： We build edges among nodes based on word occurrence in documents (document-word edges) and word co-occurrence in the whole corpus (word-word edges)

edge weight

也和TextGCN一样

node data

不同

重点是解决了TextGCN和BERT一起联调的收敛问题