Open Access Open Access  Restricted Access Subscription Access

Sarcasm Detection with A New CNN+BiLSTM Hybrid Neural Network and BERT Classification Model.


Affiliations
1 Department of Software Engineering, Firat University, Elazig-23000, Turkey
2 Department of Software Engineering, Firat University, Elazig-23000., Turkey

One of the most common effects in the use of social media today is thatpeople constantly make fun of each other or certain issues or do not take them seriously. Some comments made by sarcastic people in this widespread effect are misunderstood or taken seriously by other users. Some sarcastic comments, especially in the news headlines, create false effects on the readers and create some misunderstandings for people who donot have this sense of humor. Although there are numerous studies on the problem of sarcasm detection, even low performance increment in automatic sarcasm detection is very important and popular task. In this paper, a new hybrid deep neural model is proposed for more efficient automatic detection of sarcastic context. It is aimed to detect sarcasm using a hybrid neural network model CNN+BILSTM and BERT models with bidirectional language processing in a dataset consisting of headlines of The Onion News, which made such sarcastic headlines,and professionally prepared headlines without any sarcastic comments. When the results of this study were examined, it was seen that the model that gave the best results was BERT. In addition, accuracy, precision, recall and F1 score values were checked without using Glove embeddings in the CNN+BiLSTM model, and then the results were compared by applying Glove embeddings. In this comparison, the CNN+BiLSTM model without Glove embeddings gave relatively better results.

Keywords

Sarcasm Detection, BERT, CNN+BiLSTM, Deep Learning, Hybrid Model.
User
Notifications
Font Size

  • G. Abercrombie and D. Hovy, Putting Sarcasm Detection into Context: The Effects of Class Imbalance and Manual Labelling on Supervised Machine Classification of Twitter Conversations, Proceedings of the ACL 2016 student research workshop, 2016, pp. 107-113.
  • N. Jansen and A. Chen, Prosodic encoding of sarcasm atthe sentence level in Dutch, 10th International Conference on Speech Prosody, 2020, pp. 25-28.
  • M. Kolhar, R. N. A. Kazi and A. Alameen, Effect of Social Media Use on Learning, Social Interactions, and Sleep Duration Among University Students, SaudiJournal of Biological Sciences, vol. 28, no. 4, 2021, pp. 2216-2222.
  • S. Guldal, N. A. Kilicoglu and F. Kasapoglu, Psychological Flexibility, Coronavirus Anxiety, Humor and Social Media Addiction During COVID-19 Pandemic in Turkey, International Journal for the Advancement of Counselling, vol. 44, no. 2, 2022, pp. 220-242.
  • T. Veale, Your Wit is My Command: Building AIs with a Sense of Humor, Massachusetts Institute of Technology, 2021.
  • M. Dundvall, D. Titelman, V. DeMarinis, L. Borisova and O. Cetrez, Safe but Isolated –An Interview Study with Iraqi Refugees inSweden About Social Networks, Social Support, and Mental Health, International Journal of Social Psychiatry, vol. 67, no. 4, 2021, pp. 351-359.
  • B. Osatuyi, Is Lurking an Anxiety-Masking Strategy on Social Media Sites? The Effects of Lurking and Computer Anxiety on Explaining Information Privacy Concern on Social Media Platforms, Computers in Human Behavior, vol. 49, 2015, pp. 324-332.
  • S. Jain and V. Hsu, The Lowest Form of Wit: Identifying Sarcasm in Social Media, 2015.
  • S. Saha, J. Yadav and P. Ranjan, Proposed Approach for Sarcasm Detection in Twitter, Indian Journal of Science and Technology, vol. 10, no. 25, 2017, pp. 1-8.
  • M. Cliche, 2014. [Online]. Available: https://trueratr-backend.herokuapp.com/.
  • C. Liebrecht, F. Kunneman and A. Van den Bosch, The Perfect Solution for Detecting Sarcasm in Tweets# Not, Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, 2013.
  • D. Bamman and N. A. Smith, Contextualized Sarcasm Detection on Twitter, Proceedings of the International AAAI Conference on Web and Social Media, 2015, pp. 574-577.
  • R. González-Ibáñez, S. Muresan and N. Wacholder, Identifying Sarcasm in Twitter: A Closer Look, The 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference, 2011, pp. 581-586.
  • E. Lunando and A. Purwarianti, Indonesian Social Media Sentiment Analysis with Sarcasm Detection, 2013 International Conference on Advanced Computer Science and Information Systems (ICACSIS), IEEE, 2013, pp. 195-198.
  • A. D. Dave and N. P. Desai, A Comprehensive Study of Classification Techniques for Sarcasm Detection on Textual Data, 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT), 2016, pp. 1985-1991.
  • S. G. Wicana, T. Y. İbisoglu and U. Yavanoglu, A Review on Sarcasm Detection from Machine-Learning Perspective, 2017 IEEE 11th International Conference on Semantic Computing (ICSC), 2017, pp. 469-476.
  • A. K. Jena, A. Sinha and R. Agarwal, C-Net: Contextual Network for Sarcasm Detection, Proceedings of the second workshop on figurative language processing, 2020, pp. 61-66.
  • A. R. Pathak, B. Agarwal and M. &. R., S. Pandey, Application of Deep Learning Approaches for Sentiment Analysis, Springer, Singapore: Deep learning-based approaches for sentiment analysis, 2020, pp. 1-21.
  • R. A. Potamias, G. Siolas and A. -. G. Stafylopatis, A Transformer-Based Approach to Irony and Sarcasm Detection, vol. 32, Neural Computing and Applications, 2020, pp. 17309-17320.
  • C. V. Hee, E. Lefever and V. Hoste, Semeval-2018 Task 3: Irony Detection in English Tweets, Proceedings of The 12th International Workshop on Semantic Evaluation, 2018, pp. 39-50.
  • M. Khodak, N. Saunshi and K. Vodrahalli, A Large Self-Annotated Corpus for Sarcasm, arXiv preprint arXiv:1704.05579, 2017.
  • E. Riloff, A. Qadir, P. Surve, L. D. Silva, N. Gilbert and R. Huang, Sarcasm as Contrast between a Positive Sentiment and Negative Situation, Proceedings of the 2013 conference on empirical methods in natural language processing, pp. 704-714, 2013.
  • N. Krishnan, J. Rethnaraj and M. Saravanan, Sentiment Topic Sarcasm Mixture Model to Distinguish Sarcasm Prevalent Topics Based on the Sentiment Bearing Words in the Tweets, vol. 12, Journal of Ambient Intelligence and Humanized Computing, 2021, pp. 6801-6810.
  • S. Minaee, N. Kalchbrenner, E. Cambria, N. Nikzad, M. Chenaghlu and J. Gao, Deep Learning-Based Text Classification: A Comprehensive Review, ACM Computing Surveys (CSUR), vol. 54, no. 3, pp. 1-40, 2021.
  • A. Ahmet and T. Abdullah, Recent Trends and Advances in Deep Learning-Based Sentiment Analysis, Deep learning-based approaches for sentiment analysis, 2020, pp. 33-56.
  • R. Misra, News Headlines Dataset for Sarcasm Detection, Kaggle, 2019, Accessed: 26 July 2022. [Online]. Available: https://www.kaggle.com/datasets/rmisra/news-headlines-dataset-for-sarcasm-detection.
  • R. Misra and P. Arora, Sarcasm Detection using Hybrid Neural Network, arXiv:1908.07414, 2019.
  • S. Kaya and B. Alatas, A New Hybrid LSTM-RNN Deep Learning Based Racism, Xenomy, And Genderism Detection Model In Online Social Network, International Journal of Advanced Networking and Applications, vol. 14, no. 2, pp. 5318-5328, 2022.

Abstract Views: 126




  • Sarcasm Detection with A New CNN+BiLSTM Hybrid Neural Network and BERT Classification Model.

Abstract Views: 126  | 

Authors

Sule Kaya
Department of Software Engineering, Firat University, Elazig-23000, Turkey
Bilal Alatas
Department of Software Engineering, Firat University, Elazig-23000., Turkey

Abstract


One of the most common effects in the use of social media today is thatpeople constantly make fun of each other or certain issues or do not take them seriously. Some comments made by sarcastic people in this widespread effect are misunderstood or taken seriously by other users. Some sarcastic comments, especially in the news headlines, create false effects on the readers and create some misunderstandings for people who donot have this sense of humor. Although there are numerous studies on the problem of sarcasm detection, even low performance increment in automatic sarcasm detection is very important and popular task. In this paper, a new hybrid deep neural model is proposed for more efficient automatic detection of sarcastic context. It is aimed to detect sarcasm using a hybrid neural network model CNN+BILSTM and BERT models with bidirectional language processing in a dataset consisting of headlines of The Onion News, which made such sarcastic headlines,and professionally prepared headlines without any sarcastic comments. When the results of this study were examined, it was seen that the model that gave the best results was BERT. In addition, accuracy, precision, recall and F1 score values were checked without using Glove embeddings in the CNN+BiLSTM model, and then the results were compared by applying Glove embeddings. In this comparison, the CNN+BiLSTM model without Glove embeddings gave relatively better results.

Keywords


Sarcasm Detection, BERT, CNN+BiLSTM, Deep Learning, Hybrid Model.

References