Intent Detection Using Contextualized Deep SemSpace

Abstract

In this study, a new approach called Contextualized Deep SemSpace is proposed for intent detection. First, the synset vectors are determined by training the generalized SemSpace method with the WordNet 3.1 data. Then, each word in an intent dataset is transformed into a synset vector by a contextualized approach, and finally, the synset vectors are trained with a deep learning model using BLSTM. Since the proposed approach adapts the contextualized semantic vectors to the dataset with a deep learning model, it treats like one of contextualized deep embeddings like BERT, ELMo, and GPT-3 methods. In order to measure the success of the proposed approach, some experiments have been carried out on six well-known intent detection benchmark datasets (ATIS, Snips, Facebook, Ask Ubuntu, WebApp, and Chatbot). Although the dependence of its vocabulary on WordNet causes a serious number of out of vocabulary problems, results showed that the proposed approach is the most successful intent classifier in the literature. According to these results, it can be said that deep learning-based contextualized synset vectors can be used successfully in many problems. © 2022, King Fahd University of Petroleum & Minerals.