skip to main content
research-article

TRG-DAtt: The Target Relational Graph and Double Attention Network Based Sentiment Analysis and Prediction for Supporting Decision Making

Published: 28 October 2021 Publication History

Abstract

The management of public opinion and the use of big data monitoring to accurately judge and verify all kinds of information are valuable aspects in the enterprise management decision-making process. The sentiment analysis of reviews is a key decision-making tool for e-commerce development. Most existing review sentiment analysis methods involve sequential modeling but do not focus on the semantic relationships. However, Chinese semantics are different from English semantics in terms of the sentence structure. Irrelevant contextual words may be incorrectly identified as cues for sentiment prediction. The influence of the target words in reviews must be considered. Thus, this paper proposes the TRG-DAtt model for sentiment analysis based on target relational graph (TRG) and double attention network (DAtt) to analyze the emotional information to support decision making. First, dependency tree-based TRG is introduced to independently and fully mine the semantic relationships. We redefine and constrain the dependency and use it as the edges to connect the target and context words. Second, we design dependency graph attention network (DGAT) and interactive attention network (IAT) to form the DAtt and obtain the emotional features of the target words and reviews. DGAT models the dependency of the TRG by aggregating the semantic information. Next, the target emotional enhancement features obtained by the DGAT are input to the IAT. The influence of each target word on the review can be obtained through the interaction. Finally, the target emotional enhancement features are weighted by the impact factor to generate the review's emotional features. In this study, extensive experiments were conducted on the car and Meituan review data sets, which contain consumer reviews on cars and stores, respectively. The results demonstrate that the proposed model outperforms the existing models.

References

[1]
F. Tian, F. Wu, K. M. Chao, et al. 2016. A topic sentence-based instance transfer method for imbalanced sentiment classification of Chinese product reviews[J]. Electronic Commerce Research and Applications 16, (2016), 66–76.
[2]
J. S. Lerner, Y. Li, P. Valdesolo, et al. 2015. Emotion and decision making[J]. Annual Review of Psychology 2015, 66.
[3]
R. Adolphs and A. R. Damasio. 2000. The interaction of affect and cognition: A neurobiological perspective[C]. Jp, Forgas Handbook of Affect & Social Cognition London: Lawrence & Associates. 2000.
[4]
O. Ybarra, E. Kross, D. S. Lee, et al. 2013. Toward a more contextual, psychological, and dynamic model of emotional intelligence[M]. Emerald Group Publishing Limited 2013.
[5]
G. Coricelli, R. J. Dolan, and A. Sirigu. 2007. Brain, emotion and decision making: the paradigmatic example of regret[J]. Trends in Cognitive Sciences 11, 6 (2007), 258–265.
[6]
J. C. W. Lin, Y. Shao, Y. Zhou, M. Pirouz, and H. C. Chen. 2019. A Bi-LSTM mention hypergraph model with encoding schema for mention extraction[J]. Engineering Applications of Artificial Intelligence 2019:175–181.
[7]
M. Hao, B. Xu, J. Y. Liang, et al. 2020. Chinese short text classification with mutual-attention convolutional neural networks[J]. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 19, 5 (2020), 1–13.
[8]
K. Zhang, S. Wang, B. Li, et al. 2019. Hierarchical convolutional attention networks using joint Chinese word embedding for text classification[C]. Pacific Rim International Conference on Artificial Intelligence. Springer, Cham, 2019 234–246.
[9]
L. Yang, Y. Li, J. Wang, et al. 2019. Post text processing of Chinese speech recognition based on bidirectional LSTM networks and CRF[J]. Electronics 8, 11 (2019), 1248.
[10]
L. Xiao, X. Hu, Y. Chen, et al. 2020. Targeted sentiment classification based on attentional encoding and graph convolutional networks[J]. Applied Sciences 10, 3 (2020), 957.
[11]
S. Wang, S. Mazumder, B. Liu, et al. 2018. Target-sensitive memory networks for aspect sentiment classification[C]. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2018 957–967.
[12]
Y. Song, J. Wang, T. Jiang, et al. 2019. Targeted sentiment classification with attentional encoder network[C]. International Conference on Artificial Neural Networks. Springer, Cham 2019, 93–103.
[13]
S. Zhang, X. Xu, Y. Pang, et al. 2020. Multi-layer attention based CNN for target-dependent sentiment classification[J]. Neural Processing Letters 51, 3 (2020), 2089–2103.
[14]
K. Shuang, Y. Tan, Z. Cai, et al. 2020. Natural language modeling with syntactic structure dependency[J]. Information Sciences 2020, 523: 220–233.
[15]
Y. Zhao, B. Qin, W. Che, et al. 2011. Appraisal expression recognition with syntactic path for sentence sentiment classification[J]. International Journal of Computer Processing of Languages 23, 01 (2011), 21–37.
[16]
K. Sun, R. Zhang, S. Mensah, et al. 2019. Aspect-level sentiment analysis via convolution over dependency tree[C]. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019, 5683–5692.
[17]
Z. Li, Y. Sun, J. Zhu, et al. 2020. Improve relation extraction with dual attention-guided graph convolutional networks[J]. Neural Computing and Applications 2020, 1–12.
[18]
H. Keshavarz and M. S. Abadeh. 2017. ALGA: Adaptive lexicon learning using genetic algorithm for sentiment analysis of microblogs[J]. Knowledge-Based Systems 122, (2017) 1–16.
[19]
R. Moraes, J. O. F. Valiati, and W. P. G. O. Neto. 2013. Document-level sentiment classification: An empirical comparison between SVM and ANN[J]. Expert Systems with Applications 40, 2 (2013), 621–633.
[20]
S. S. Istia and H. D. Purnomo. 2018. Sentiment analysis of law enforcement performance using support vector machine and K-nearest neighbor[C]. 2018 3rd International Conference on Information Technology, Information System and Electrical Engineering (ICITISEE). IEEE 2018, 84–89.
[21]
H. Zhang, H. Xu, J. Shi, et al. 2019. SFV-CNN: Deep text sentiment classification with scenario feature representation[C]. International Conference on Mathematical Aspects of Computer and Information Sciences. Springer, Cham 2019, 382–394.
[22]
Y. Zhang, Z. Zhang, D. Miao, et al. 2019. Three-way enhanced convolutional neural networks for sentence-level sentiment classification[J]. Information Sciences 477, (2019), 55–64.
[23]
N. Jin, J. Wu, X. Ma, et al. 2020. Multi-task learning model based on multi-scale CNN and LSTM for sentiment classification[J]. IEEE Access 8, (2020), 77060–77072.
[24]
Y. Xu, L. Li, H. Gao, et al. 2020. Sentiment classification with adversarial learning and attention mechanism[J]. Computational Intelligence 2020(1).
[25]
T. Ji, Y. Wu, and M. Lan. 2019. Graph-based dependency parsing with graph neural networks[C]. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics 2019, 2475–2485.
[26]
M. Cao, S. Zhou, and H. Gao. 2019. A recommendation approach based on product attribute reviews: Improved collaborative filtering considering the sentiment polarity[J]. Intelligent Automation and Soft Computing 25, 3 (2019), 593–602.
[27]
X. Yang, S. Zhou, and M. Cao. 2019. An approach to alleviate the sparsity problem of hybrid collaborative filtering based recommendations: The product-attribute perspective from user reviews[J]. Mobile Networks and Applications, 2019.
[28]
Z. Yang, D. Yang, C. Dyer, et al. 2016. Hierarchical attention networks for document classification[C]. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies 2016, 1480–1489.
[29]
K. Al-Sabahi, Z. Zuping, and M. Nadher. 2018. A hierarchical structured self-attentive model for extractive document summarization (HSSAS)[J]. IEEE Access 6, (2018), 24205–24212.
[30]
Q. Liu, J. Lu, G. Zhang, et al. 2020. Domain-specific meta-embedding with latent semantic structures[J]. Information Sciences 2020.
[31]
Y. Hu, Y. Wong, W. Wei, et al. 2018. A novel attention-based hybrid CNN-RNN architecture for sEMG-based gesture recognition[J]. PloS One 13, 10 (2018), e0206049.
[32]
Y. Ma, H. Peng, and E. Cambria. 2018. Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive LSTM[C]. Aaai. 2018: 5876–5883.
[33]
Tang Duyu et al. 2015. Effective LSTMs for target-dependent sentiment classification. arXiv preprint arXiv:1512.01100 (2015).
[34]
W. Gao, Y. Zhu, W. Zhang, et al. 2019. A hierarchical recurrent approach to predict scene graphs from a visual attention, riented perspective[J]. Computational Intelligence 2019.
[35]
J. C. W. Lin, Y. Shao, Y. Djenouri, and U. Yun. 2020. ASRNN: A recurrent neural network with an attention model for sequence labeling[J]. Knowledge-Based Systems 2020.
[36]
P. Veličković, G. Cucurull, A. Casanova, et al. 2017. Graph attention networks[J]. arXiv preprint arXiv:1710.10903, 2017.
[37]
M. Zitnik, M. Agrawal, and J. Leskovec. 2018. Modeling polypharmacy side effects with graph convolutional networks[J]. Bioinformatics 34, 13 (2018), i457–i466.
[38]
K. He, X. Chen, Q. Wu, et al. 2020. Graph attention spatial-temporal network with collaborative global-local learning for citywide mobile traffic prediction[J]. IEEE Transactions on Mobile Computing 2020.
[39]
A. Vaswani, N. Shazeer, N. Parmar, et al. 2017. Attention is all you need[C]. Advances in Neural Information Processing Systems 2017, 5998–6008.
[40]
Y. Cheng, L. Yao, G. Xiang, et al. 2020. Text sentiment orientation analysis based on multi-channel CNN and bidirectional GRU with attention mechanism[J]. IEEE Access 8 (2020), 134964–134975.
[41]
L. Zhang, Z. Liu, S. Zhang, et al. 2019. Cross-modality interactive attention network for multispectral pedestrian detection[J]. Information Fusion 50, (2019), 20–29.
[42]
P. Goyal and H. Kaiming. 2018. Focal loss for dense object detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence 39, (2018), 2999–3007.
[43]
M. L. Booth, A. D. Okely, T. Chey, et al. 2002. The reliability and validity of the adolescent physical activity recall questionnaire[J]. Medicine & Science in Sports & Exercise 34, 12 (2002), 1986–1995.
[44]
I. Goodfellow, Y. Bengio, A. Courville, et al. 2016. Deep Learning[M]. Cambridge: MIT press, 2016.
[45]
J. Liu, Y. Yang, S. Lv, et al. 2019. Attention-based BiGRU-CNN for Chinese question classification[J]. Journal of Ambient Intelligence and Humanized Computing 2019, 1–12.
[46]
J. X. Chen, D. M. Jiang, and Y. N. Zhang. 2019. A hierarchical bidirectional GRU model with attention for EEG-based emotion classification[J]. IEEE Access 7, (2019) 118530–118540.
[47]
J. Devlin, M. W. Chang, K. Lee, et al. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding[J]. arXiv preprint arXiv:1810.04805, 2018.
[48]
X. Chen, C. Sun, J. Wang, et al. 2020. Aspect sentiment classification with document-level sentiment preference modeling[C]. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 2020, 3667–3677.

Cited By

View all
  • (2024)Sentiment Analysis: Decoding Workspace Emotions2024 MIT Art, Design and Technology School of Computing International Conference (MITADTSoCiCon)10.1109/MITADTSoCiCon60330.2024.10575174(1-4)Online publication date: 25-Apr-2024
  • (2023)Ensemble Active Learning by Contextual Bandits for AI Incubation in ManufacturingACM Transactions on Intelligent Systems and Technology10.1145/362782115:1(1-26)Online publication date: 19-Dec-2023
  • (2023)Cross-Domain Aspect-Based Sentiment Classification by Exploiting Domain- Invariant Semantic-Primary FeatureIEEE Transactions on Affective Computing10.1109/TAFFC.2023.323954014:4(3106-3119)Online publication date: 24-Jan-2023
  • Show More Cited By

Index Terms

  1. TRG-DAtt: The Target Relational Graph and Double Attention Network Based Sentiment Analysis and Prediction for Supporting Decision Making

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Management Information Systems
      ACM Transactions on Management Information Systems  Volume 13, Issue 1
      March 2022
      203 pages
      ISSN:2158-656X
      EISSN:2158-6578
      DOI:10.1145/3483343
      Issue’s Table of Contents

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 28 October 2021
      Accepted: 01 April 2021
      Revised: 01 April 2021
      Received: 01 December 2020
      Published in�TMIS�Volume 13, Issue 1

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Sentiment analysis
      2. decision making
      3. target relational graph
      4. graph attention network
      5. interactive attention network
      6. dependency relationship
      7. prediction

      Qualifiers

      • Research-article
      • Refereed

      Funding Sources

      • National Key R&D Program of China

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)79
      • Downloads (Last 6 weeks)6
      Reflects downloads up to 16 Oct 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Sentiment Analysis: Decoding Workspace Emotions2024 MIT Art, Design and Technology School of Computing International Conference (MITADTSoCiCon)10.1109/MITADTSoCiCon60330.2024.10575174(1-4)Online publication date: 25-Apr-2024
      • (2023)Ensemble Active Learning by Contextual Bandits for AI Incubation in ManufacturingACM Transactions on Intelligent Systems and Technology10.1145/362782115:1(1-26)Online publication date: 19-Dec-2023
      • (2023)Cross-Domain Aspect-Based Sentiment Classification by Exploiting Domain- Invariant Semantic-Primary FeatureIEEE Transactions on Affective Computing10.1109/TAFFC.2023.323954014:4(3106-3119)Online publication date: 24-Jan-2023
      • (2023)Aspect and orientation-based sentiment analysis of customer feedback using mathematical optimization modelsKnowledge and Information Systems10.1007/s10115-023-01848-z65:6(2731-2760)Online publication date: 8-Mar-2023
      • (2022)Text Mining of User-Generated Content (UGC) for Business Applications in E-Commerce: A Systematic ReviewMathematics10.3390/math1019355410:19(3554)Online publication date: 29-Sep-2022
      • (2022)Sentiment Analysis of Roman Urdu on E-Commerce Reviews Using Machine LearningComputer Modeling in Engineering & Sciences10.32604/cmes.2022.019535131:3(1263-1287)Online publication date: 2022
      • (2022)Logic tensor network with massive learned knowledge for aspect-based sentiment analysisKnowledge-Based Systems10.1016/j.knosys.2022.109943257:COnline publication date: 5-Dec-2022
      • (2022)Tailored text augmentation for sentiment analysisExpert Systems with Applications: An International Journal10.1016/j.eswa.2022.117605205:COnline publication date: 1-Nov-2022

      View Options

      Get Access

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      Full Text

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media