Assessfy Pvt. Ltd Advanced 5 milestones 100 marks

Distributed File Storage System using gRPC (Mini-HDFS)

Target year: BE Sem 7-8 (Major Project Phase-I/II) AICTE: 6 credits · ~150 hrs Bloom: Create / Evaluate MU CBCS: CSC801 / CSDLO8021 BE Project

Real-world project · AICTE-aligned · AI-graded · Audit-ready certificate

Enroll as Student Mentor this project

Milestones

Available mentors

Enrolled students

Core skills

About this project

Design and implement a mini distributed file system where files are sharded across 3+ storage nodes with replication. Client uploads/downloads via a gateway; system survives one node going down. Inspired by HDFS / IPFS at a learnable scale.

Course Learning Outcomes (CLOs):
CLO1: Design a distributed-systems architecture trading off consistency, availability, and partition tolerance.
CLO2: Implement RPC-based service communication using gRPC + Protocol Buffers.
CLO3: Build sharding + replication logic with documented failure semantics.
CLO4: Implement heartbeat + failure-detection + automatic failover.
CLO5: Benchmark and characterize system performance vs a single-node baseline.

Industry/societal relevance: Distributed storage powers every cloud (S3, GCS, Azure Blob); direct prep for SDE-2 / cloud-infra interviews at FAANG / Indian unicorns.

Milestones

1. Architecture & gRPC Schema Design

15 marks 10d

Decide chunk size, replication factor, sharding scheme. Write .proto for client↔gateway and gateway↔storage-node. Submit sequence diagrams for upload + download.

2. Single-Node Storage Server

20 marks 14d

Implement one storage node that accepts chunk PUTs and serves chunk GETs over gRPC. Persistence to local disk. Unit tests for chunk read/write.

3. Gateway with Sharding + Replication

25 marks 21d

Gateway that splits file into N chunks, places each on 2-of-3 nodes (replication=2). Stores file→chunk metadata. Handles upload + download flows.

4. Fault Tolerance + Heartbeat

20 marks 18d

Storage nodes send heartbeat to gateway every 5s. Gateway marks dead nodes after 15s. On read, gateway picks a live replica. Demo killing a node mid-download.

5. End-to-End Demo + Benchmark + Report

20 marks 17d

Docker Compose with 1 gateway + 3 storage nodes. Upload 100 MB file, kill a node, download still works. Measure read/write throughput vs single-node baseline. 8-page IEEE-format report.

Open internships using this project -->

Skills you'll learn

Distributed SystemsgRPCProtocol BuffersConsensus basics (Raft)TCP/IP NetworkingConcurrencyFault ToleranceBenchmarking

Tools used

Go 1.21 (or Python 3.11 + grpcio)gRPCProtocol Buffers (proto3)Docker + Docker Composeetcd (or in-memory metadata)GitHub

Prerequisites

Operating Systems (processesIPC); Computer Networks (TCPsockets); at least one of Go or Python at intermediate level; comfort with command line + Docker

Available mentors

No mentors have signed up for this project yet.

Be the first to mentor

You'll earn — Certificate (PDF)

AICTE-aligned Project Completion Certificate

A formal, audit-ready PDF certificate issued by Assessfy + your institute on successful completion. Includes AICTE credit hours, your evaluator's signature, and a QR code for third-party verification.

AICTE-aligned

Certificate of Project Completion

This is to certify that

has successfully completed the project

Distributed File Storage System using gRPC (Mini-HDFS)

Scan to Verify

Date

Signature

Auto-issued on completion QR-verifiable

You'll earn — Digital Badge

Shareable LinkedIn / Resume Skill Badge

A compact, verifiable Open-Badges-2.0-compliant digital credential. Add to your LinkedIn profile, GitHub README, or resume in one click. Recruiters can validate authenticity via a unique URL.

Advanced

Distributed File Storage System using…

Assessfy

Auto-issued on completion One-click LinkedIn add