- What Is Deep Learning and How Will It Change Healthcare?
- How Machine Learning Can Guide COVID-19 Decision-Making
- Using Machine Learning to Enhance COVID-19 Prediction Models
The research team began by creating a deep learning model designed to detect and classify emotion. Their model, the Average Voting Ensemble Deep Learning (AVEDL) model, was developed by combining the pre-trained transformer-based models BERT, DistilBERT, and RoBERTa.
AVEDL was trained and tested for emotion detection using two datasets.
The first dataset was based on COVID-19 related calls received by the Emergency Response Support System (ERSS) in Kerala, India. Call recordings containing the words “corona,” “COVID-19,” “quarantine,” “COVID,” and “lockdown” from January to March 2021 were randomly selected and transcribed. Each call was annotated and labeled based on emotion by three individuals to avoid bias. Over 20,000 calls were included in the dataset.
The second dataset was made up of 124,740 tweets from an already existing database of COVID-19 related tweets labeled for emotion analysis. AVEDL was trained and tested to detect emotions like sadness, anger, anticipation, fear, or no specific emotion because these made up the majority of the labels in the datasets.
The combined datasets were then divided into training, testing, and validation sets.
When evaluating how successful the models were in distinguishing specific emotions from a group of emotions, the AVEDL model significantly outperformed the other algorithms. The AVEDL model achieved an accuracy of 86.46 percent, while DistilBERT, BERT, and RoBERTa achieved maximum accuracies of 84.86 percent, 84.91 percent, and 85.69 percent. Despite this success, the AVEDL model is limited in that its time complexity is high compared to the others, meaning that its analysis takes longer to complete. The model also performs poorly when using the normal ERSS dataset, which is not related to pandemics.
To combat these limitations, more research is needed, but the researchers posit that the current model has potential as a digital health intervention. They indicate that the model could be used in ERSS call centers to analyze call content in real time to classify emotions, allowing the call center representative to identify callers feeling fear or anger and forward the call to a mental health professional equipped to deal with emotional distress.
The researchers also note that their model has the potential to be used in social media post analyses, allowing automated messaging and education to be provided based on the emotions and attitudes detected in the user’s post. The authors suggest that personalized education interventions could provide emotional support and ensure emotional wellbeing in the event of a future pandemic.