Statistical Challenges in Social Media Data Analysis Sentiment Tracking and Beyond

Title: Statistical Challenges in Social Media Data Analysis Sentiment Tracking and Beyond
Abstract: Background: Social media has emerged as an important forum for public discourse, generating a large amount of data for sentiment analysis and other insights. However, the enormous and unstructured nature of social media data presents substantial statistical hurdles, which can affect the quality and reliability of results. Objective: The article aims to investigate and address the statistical issues that arise while analyzing social media data, emphasizing sentiment tracking. By identifying and addressing these problems, the study aims to improve the accuracy and reliability of sentiment analysis and broaden its uses. Methods: The article conducts a complete literature review to identify typical statistical problems in social media data analysis. These issues are addressed by developing and implementing advanced statistical approaches, such as natural language processing (NLP) and machine learning algorithms. Data from several social media platforms (over 1 million posts and comments) is collected and evaluated to test these strategies. Results: The findings reveal several significant obstacles, including lack of data (with over 60% of posts containing limited sentiment indicators), excessive dimensionality (with an average of 200 features per post), noise (30% of data classified as irrelevant), and social media data bias (found in 25% of posts). Advanced statistical approaches result in a 15% increase in sentiment classification accuracy and a 20% decrease in noise. The findings also indicate the possibility of applying these strategies to other social media data analysis areas. Conclusion: Addressing statistical issues in social media data analysis is critical for improving the accuracy and reliability of sentiment tracking. Advanced statistical techniques, particularly those based on NLP and machine learning, provide intriguing possibilities. Future research should focus on improving these algorithms and expanding their uses beyond sentiment analysis.
Scientific Type: غير معروف
Link: https://ecohumanism.co.uk/joe/ecohumanism/article/view/3912
Journal volume: Volume 3, Issue 5
Collaboration type: مشترك
Publish Date: September 4, 2024
Participated Universities (Publication): Alnoor University
Scopus status: In Scopus
Scopus index year: 2 024
Scopus quarter: 3
Scopus citation score: 0.100000001
Clarivate status: Not In Clarivate
Pub. Med. status: Not In PubMed
Author (Publication): نبأ محمد ضياء يونس سليمان
Journal (Publication): Journal of Ecohumanism
Publisher (Publication): Creative Publishing House
ISSN: 2752-6798
Country (Publication): United kingdom
Country type: عالمية
College (Publication): College of Engineering
Departement (Publication): Department of Construction Engineering & Project Management

Media: Academic paper

Part of Statistical Challenges in Social Media Data Analysis Sentiment Tracking and Beyond