My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on ​lambda architecture​, that aggregates Twitter and US stock market data for user sentiment analysis using open source tools - ​Apache Kafka ​for data ingestions, Apache Spark ​& ​Spark Streaming ​for batch & real-time processing, ​Apache Cassandra f​ or storage, ​Flask​, ​Bootstrap and ​HighCharts f​ or frontend.

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Twitter Sentiment Analysis using Spark and Kafka

Real-time Machine Learning with Apache Spark on Twitter Public Stream

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

Counting Tweets Per User in Real-Time

Counting Twitter hashtags using Spark Streaming and Cassandra

This repo contains Big Data Project, its about "Real Time Twitter Sentiment Analysis via Kafka, Spark Streaming, MongoDB and Django Dashboard".

Spark project written in Scala used to perform real time sentiment analysis on top of Twitter's streaming API

Analyzing Twitter real time feed with Spark Streaming

Real-time dashboard for Twitter Sentiment analysis using Spark Streaming and Watson Tone Analyzer

Ingest tweets with Kafka. Use Spark to track popular hashtags and trendsetters for each hashtag

A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and Delta Lake.

Machine Learning over Twitter's stream. Using Apache Spark, Web Server and Lightning Graph server.

a demo project to Analyze most popular twitter hashtags using Java 8 Spring-Boot Spark Streaming Kafka & Docker Demo.

Example integration of Kafka, Avro & Spark-Streaming on live Twitter feed

Live Twitter sentiment analysis using Python, Apache Spark Streaming, Kafka, NLTK, SocketIO

Personal project where I perform some analytics (including Sentiment Analysis) over a Twitter Stream using Big Data Technologies of the Hadoop echosystem such as Flume, Kafka, and Spark Streaming.

Twitter real-time sentiment analysis using Spark Structured Streaming and Python

A Spark Streaming demo framework that implements and improves the functions of Twitter Rainbird

Named Entity Extraction on Twitter Stream using Apache Spark Streaming and Stanford CoreNLP

A spark based twitter streaming application that was used to process valentines tweets from all over India during the Valentines week of 2016 for analyzing the cities and states of India in love

Building pipeline to process the real-time data using Spark and Mongodb.

Ingesting real-time Twitter API using tweepy into Kafka and process using Apache Spark Structured Streaming with Sentiment Analysis TextBlob before loading into time-series database, InfluxDB and monitoring dashboard, Grafana

Using Spark Streaming to send tweets from Twitter Streaming API to Elasticsearch

Twitter Streaming with Spark - Texas Senate Elections

Twitter Spark Streaming using PySpark

A Spark Streaming implementation for Online Twitter Sentiment Analysis.

Reading the Twitterstream from the Twitter-API with Kafka and stream them into an Spark-Cluster to process it

Recommendation systems, Twitter Streaming, SON Algorithm,Frequent Itemsets, , BFR, AMS, Bloom Filter, Community Detection using Modularity, Girvan-Newman Algorithm implementation in Spark-Python.