Data/BigData Projects
855 projects · Page 1 of 36
Streaming Log Anomaly Detector CLI
Already built and tested (11 passing tests). You will learn streaming log parsing, rolling z-score anomaly detection and command-line tool design.…
Streaming CSV Schema Validator with Row Quarantine
Already built and tested (12 passing tests). You will learn streaming validation of large files, typed column schemas, quarantine outputs and JSON error reporting.…
Mini Kafka: In-Memory Message Broker with Consumer Groups
Already built, mvn verify green (9 tests). You will learn how Kafka works inside - topics, partitions, consumer groups, offsets and replay - by building a working broker.…
Append-Only Inventory Ledger with Trigger-Maintained Balances
Already built (6 lint-passed SQL files). You will learn ledger-style schema design, balance-maintaining triggers that block tampering, and valuation reporting views.…
Appointment Booking System with Double-Booking Prevention
Already built (6 lint-passed SQL files). You will learn overlap detection with FOR UPDATE locking, BEFORE INSERT triggers and utilisation reporting.…
Billing Engine: Invoices, Tax Rules and Payment Ageing
Already built (5 lint-passed SQL files). You will learn invoice/line-item modelling, tax and discount recalculation procedures, payment allocation and ageing reports.…
Temporal Audit Trail with Point-in-Time Reconstruction
Already built (6 lint-passed SQL files). You will learn history-table design, JSON change snapshots and procedures that rebuild any record as of a past timestamp.…
E-Commerce Cohort, Funnel and RFM Analytics Pack
Already built (5 lint-passed SQL files). You will learn advanced SQL analytics - cohort retention, funnel conversion and RFM customer segmentation with window functions.…
Python Data Pipeline Toolkit (ETL with Validation and Lineage)
Already built as a resume-grade project. You will learn ETL pipeline architecture, schema validation, incremental loads and data-lineage tracking.…
MySQL Analytics Schema: Star Design for Business Reporting
Already built as a resume-grade project. You will learn star-schema design, fact/dimension modelling and analytics query patterns.…
BigQuery Warehouse Analytics: Partitioned ELT at Scale
Already built as a resume-grade project. You will learn partitioned/clustered table design, ELT modelling and cost-aware query optimisation on BigQuery.…
SingleStore Real-Time Analytics: Streaming Ingest + Live Dashboards
Already built as a resume-grade project. You will learn HTAP concepts, streaming ingest pipelines and low-latency analytical queries.…
Dataflow Streaming Pipeline with Dead-Letter Handling
Already built, 17 tests passing plus an end-to-end local run. You will learn event-time windowing, validation contracts and dead-letter patterns for streaming data.…
Real-Time Social Media Sentiment Pipeline with Kafka and Spark
Build a streaming pipeline that scores sentiment live. You will learn stream processing, windowing and throughput tuning.…
Data Warehouse for Retail Sales with ETL and BI Dashboard
Build a retail warehouse with scheduled ETL and dashboards. You will learn dimensional modelling and BI storytelling.…
Big Data Analysis of Road Accidents Using Hadoop/Spark
Build an analysis of accident hotspots and causes on large open data. You will learn distributed dataframes and geospatial aggregation.…
YouTube Trending Analytics with API Data Pipeline
Build a pipeline that tracks trending videos and channel growth. You will learn API pagination, incremental loads and dashboarding.…
IPL Cricket Analytics Dashboard (2008-Present Data)
Build player/team analytics from ball-by-ball data. You will learn sports data modelling and interactive visual analysis.…
Analysis of NHANES Data: BMI and Hypertension Prevalence Association
Analyse public NHANES cycles with survey-weighted methods to estimate the BMI-hypertension association. You will learn complex survey design, weighting and weighted regression.…
Diabetes Prevalence and Risk Factors: NHANES Analysis in R
Estimate diabetes prevalence and model risk factors from public NHANES data with reproducible R notebooks. You will learn survey analytics and reproducible reporting.…
Anaemia Among Women and Children: NFHS-5 Public Data Study
Study state-level anaemia patterns from published NFHS-5 aggregates and relate them to programme indicators. You will learn secondary-data analysis and ecological interpretation.…
Maternal Mortality Trends in India from Public SRS Bulletin Data
Compile and analyse maternal mortality trends from public Sample Registration System bulletins across states and periods. You will learn trend analysis and rate standardisation.…
Air Pollution and Respiratory Visits: Open-Data Time-Series Study
Relate public air-quality series to synthetic respiratory-visit counts with lag analysis. You will learn distributed-lag thinking and time-series confounding control.…
COVID-19 Wave Dynamics in India: Public Dashboard Data Modelling
Model historical public COVID-19 case series to compare wave timing, growth rates and peak loads across states. You will learn epidemic curve methods and Rt estimation basics.…