Skip to content
/ KGAN Public

[TKDE] Knowledge Graph Augmented Network Towards Multiview Representation Learning for Aspect-based Sentiment Analysis

Notifications You must be signed in to change notification settings

WHU-ZQH/KGAN

Repository files navigation

KGAN: Knowledge Graph Augmented Network Towards Multi-view Representation Learning for Aspect-based Sentiment Analysis


News

4/2/2024

  • Our code is updated, i.e., fixing the scripts for BERT-based models.

6/3/2023

  • Our paper has been accepted by IEEE Transactions on Knowledge and Data Engineering. (Paper)

26/4/2022

  • Knowledge graph embeddings is added. Additionally, we update the implementation of KGNN-BERT and ASGCN-BERT. The corresponding training code is also updated.

Requirements

  • python 3.7
  • pytorch-gpu 1.7
  • numpy 1.19.4
  • pytorch_pretrained_bert 0.6.2
  • nltk 3.3
  • spacy 2.2.0
  • en_core_web_sm 2.1.0
  • GloVe.840B.300d
  • bert-base-uncased

Environment

  • OS: Windows 10
  • GPU: NVIDIA GeForce GTX 1660 SUPER
  • CUDA: 11.0
  • cuDNN: v8.0.4

Dataset

  • raw data: "./dataset/"
  • processing data: "./dataset_npy/"
  • word embedding file: "./embeddings/"
  • Knowledge graph embedding file: download from Google Drive

Training options

  • ds_name: the name of target dataset, ['14semeval_laptop','14semeval_rest','15semeval_rest','16semeval_rest','Twitter'], default='14semeval_rest'
  • bs: batch size to use during training, [32, 64], default=64
  • learning_rate: learning rate to use, [0.001, 0.0005], default=0.001
  • dropout_rate: dropout rate for sentimental features, [0.1, 0.3, 0.5], default=0.05
  • n_epoch: number of epoch to use, default=20
  • model: the name of model, default='KGNN'
  • dim_w: the dimension of word embeddings, default=300
  • dim_k: the dimension of graph embeddings, [200,400], default=200
  • is_test: train or test the model, [0, 1], default=1
  • is_bert: GloVe-based or BERT-based, [0, 1], default=0

More training options can be found in "./main_total.py".

Running

training based on GloVe:

  • python -m main_total -ds_name 14semeval_laptop -bs 32 -learning_rate 0.001 -dropout_rate 0.5 -n_epoch 20 -model KGNN -dim_w 300 -dim_k 400 -kge analogy -gcn 0 -is_test 0 -is_bert 0
  • python -m main_total -ds_name 14semeval_rest -bs 64 -learning_rate 0.001 -dropout_rate 0.5 -n_epoch 20 -model KGNN -dim_w 300 -dim_k 200 -kge distmult -gcn 0 -is_test 0 -is_bert 0

training based on BERT:

  • python -m main_total -ds_name 14semeval_laptop -bs 32 -learning_rate 0.00003 -n_epoch 20 -model KGNN -dim_w 768 -dim_k 400 -kge analogy -gcn 0 -is_test 0 -is_bert 1
  • python -m main_total -ds_name 14semeval_rest -bs 64 -learning_rate 0.00003 -n_epoch 20 -model KGNN -dim_w 768 -dim_k 200 -kge distmult -gcn 0 -is_test 0 -is_bert 1

The detailed training scripts can be found in "./scripts".

Evaluation

To have a quick look, we saved the best model weight trained on the evaluated datasets in the "./model_weight/best_model_weight". You can easily load them and test the performance. You can evaluate the model weight with:

  • python -m main_total -ds_name 14semeval_laptop -bs 32 -model KGNN -dim_w 300 -dim_k 400 -is_test 1
  • python -m main_total -ds_name 14semeval_rest -bs 64 -model KGNN -dim_w 300 -dim_k 200 -is_test 1

Notes

  • The datasets and more than 50% of the code are borrowed from TNet-ATT (Code) (Tang et.al, ACL2019).

Citation

@article{zhong2022knowledge,
  title={Knowledge Graph Augmented Network Towards Multiview Representation Learning for Aspect-based Sentiment Analysis}, 
  author={Zhong, Qihuang and Ding, Liang and Liu, Juhua and Du, Bo and Jin, Hua and Tao, Dacheng},
  journal={IEEE Transactions on Knowledge and Data Engineering}, 
  year={2023},
  pages={1-14},
  doi={10.1109/TKDE.2023.3250499}
  }

About

[TKDE] Knowledge Graph Augmented Network Towards Multiview Representation Learning for Aspect-based Sentiment Analysis

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages