Assessfy Pvt. Ltd Advanced 5 milestones 100 marks

Real-Time Sentiment Analysis Pipeline for Twitter/X (Indian Elections)

Target year: BE Sem 7-8 (Major Project Phase-I/II) AICTE: 6 credits · ~150 hrs Bloom: Create / Evaluate MU CBCS: DS801 / DSDLO8021 BE Project

Real-world project · AICTE-aligned · AI-graded · Audit-ready certificate

Enroll as Student Mentor this project

Milestones

Available mentors

Enrolled students

Core skills

About this project

Build an end-to-end streaming pipeline: ingest tweets via X API on Indian-election hashtags → Kafka → Spark Streaming → multilingual sentiment classifier (English + Hindi + Marathi) → Postgres + Grafana dashboard. Address rate limits, language detection, and bot filtering.

Course Learning Outcomes (CLOs):
CLO1: Design + implement a streaming data architecture.
CLO2: Apply multilingual NLP to a real-world stream.
CLO3: Identify + filter bot accounts using behavioral heuristics.
CLO4: Visualize streaming KPIs via Grafana.
CLO5: Discuss ethical implications of social-media analysis.

Industry/societal relevance: Election Commission of India + media houses (NDTV, Times Now) + political-tech firms (Citizens for Accountable Governance, IPAC) hire data engineers for streaming sentiment pipelines.

Milestones

1. Architecture + Docker Compose

15 marks 14d

Draw end-to-end architecture. Spin up Kafka + Spark + Postgres + Grafana via Compose. Health-check all services.

2. Twitter Ingest + Kafka Topics

20 marks 18d

Set up X API v2 streaming. Define topics by hashtag. Handle rate limits + retries.

3. Sentiment Classifier

25 marks 21d

Fine-tune IndicBERT on a labeled subset (5k tweets). Test on Hindi + English + Marathi. Macro-F1 > 0.75.

4. Bot Detection + Filtering

20 marks 18d

Implement rules: posting rate, account age, follower/following ratio. Validate on a known bot/human labeled sample.

5. Grafana Dashboard + IEEE Paper

20 marks 21d

Live dashboards: tweet volume/min, sentiment trend per party, bot %. 14-page IEEE paper + oral defense.

Open internships using this project -->

Skills you'll learn

Streaming ArchitectureApache KafkaSpark StreamingMultilingual NLP (IndicBERTXLM-R)Bot detectionGrafana dashboardingAWS/GCP basic ops

Tools used

Python 3.11Apache KafkaSpark 3.5IndicBERT (HF Transformers)PostgreSQLGrafanaDocker ComposeX API v2GitHub

Prerequisites

Distributed Systems intro; Python advanced; NLP; SQL; basic cloud / Docker

Available mentors

No mentors have signed up for this project yet.

Be the first to mentor

You'll earn — Certificate (PDF)

AICTE-aligned Project Completion Certificate

A formal, audit-ready PDF certificate issued by Assessfy + your institute on successful completion. Includes AICTE credit hours, your evaluator's signature, and a QR code for third-party verification.

AICTE-aligned

Certificate of Project Completion

This is to certify that

has successfully completed the project

Real-Time Sentiment Analysis Pipeline for Twitter/X (Indian…

Scan to Verify

Date

Signature

Auto-issued on completion QR-verifiable

You'll earn — Digital Badge

Shareable LinkedIn / Resume Skill Badge

A compact, verifiable Open-Badges-2.0-compliant digital credential. Add to your LinkedIn profile, GitHub README, or resume in one click. Recruiters can validate authenticity via a unique URL.

Advanced

Real-Time Sentiment Analysis Pipeline…

Assessfy

Auto-issued on completion One-click LinkedIn add