Twitter Trend Analysis
- 0 Collaborators
Historical Twitter data analysis to detect influencers and tracking their tweets to predict trends in real-time using LDA. ...learn more
Project status: Concept
Overview / Usage
Influencer Detection: Influencers are detected by running a PageRank algorithm on a graph representing the retweet patterns for the tweets in the dataset. Bots are filtered by analyzing the graph for motif patterns like high out degree and cliques.
Trend Analysis: Twitter Streaming APIs are used to obtain real-time tweets from the influencers and LDA is performed for topic-modeling, and the results sent to a Kafka cluster to be used by Kibana for visualization.
Technologies Used
Spark
GraphFrames
twitter4j