How tarun-kavipurapu/p2p-file-transfer works
Project Type & Purpose
• This is a hybrid peer-to-peer file-transfer system in Go, with:
• A central server (peer discovery + metadata management)
• Multiple peer servers (serve and request file chunks)
• A CLI front end (cmd/) to drive operations.
File Structure
• Top-level directories:
• central-server/ – central registry service code
• peer/ – peer node logic (chunking, storage, worker pool)
• pkg/ – shared transport, messaging, encoding, utilities
• cmd/ – CLI subcommands: cserver, peer, peer1, peer2
• Support files:
• files/ – sample assets & architecture image
• TestingFiles/ – test artifacts
• Config/build:
• go.mod, Makefile
README Insights
• Key features: peer discovery, chunk-based transfer, concurrent downloads, integrity checks
• CLI commands: central-server, peer-server, register-file, request-file
Main Components
a. CLI Layer (cmd/):
• User invokes commands → dispatches to central-server or peer logic
b. Central Server (central-server/cserver.go):
• HTTP/TCP API for peer registration & metadata storage
c. Peer Server (peer/logic.go, peer/peer.go):
• Listens for chunk requests
• Worker pool (workerpool.go) for concurrent chunk handling
• Local chunk store (store.go)
d. Shared Transport & Protocol (pkg/):
• Message types (message.go, commStructures.go)
• Encoding/decoding (encoding.go)
• TCP transport abstraction (tcp_transport.go, transport.go)
e. File Storage:
• Local filesystem or memory chunk store
• Metadata hashing & verification (metadata.go)
f. External Interfaces:
• CLI → TCP/HTTP calls
• Peers ↔ Peers over TCP
Relationships & Data Flows
• register-file (send file metadata, peer address)
• peer discovery list, heartbeat
• request-file (file ID, peer address)
• concurrent TCP connections via worker pool
Architectural Patterns & Principles
• Hybrid P2P with central registry (single point for discovery + metadata)
• Chunk-based data partitioning for parallelism and resumability
• Concurrency via worker pools
• Clear separation of concerns: CLI, business logic, transport, storage
Technologies & Libraries
• Go modules (go.mod)
• net/TCP for peer communications
• Custom encoding (JSON/gob) in pkg/encoding.go
• Logging and error handling in each layer
Final Checklist
• All major components (CLI, Central Server, Peer Servers, Storage, Transport) are present