How jamwalshah/surya_pg_dbda works
This repository is a collection of PG-DBDA coursework and examples, not one integrated application. Its sampled runtime workflows include standalone Java exercises, Hadoop MapReduce jobs, NLP experiments, and a statistics assignment. Hadoop jobs read supplied data and write results; the NLP scripts demonstrate text preparation and vectorization or Word2Vec; the statistics notebook-style script loads and analyzes bike-sharing data. These branches are independent. The graph emphasizes documented capabilities and sampled behavior; unsampled files are represented only where the tree or SOURCE INDEX supports them.
Main entry points: MapInnerJoin.java Inner map join · MapJoin.java Map-side join · CityAvg2.java City averages · MyPartitioner.java Custom partition job
Components 17
Java coursework
- Bank console
module_4_OOPJ8/OOPJ8_Notes MalkeetSingh/07.02 Bank.java - Java exercises
module_4_OOPJ8/OOPJ8_Assignments MalkeetSingh
Hadoop analytics
- City averages
module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/CityAvg2.java - Custom partition job
module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MyPartitioner.java - Map-side join
module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapJoin.java - Inner map join
module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapInnerJoin.java - Reduce-side join
module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/ReduceJoin.java
NLP experiments
- Text preparation
module_x1_TopUpSessions/TopUpSessions_Notes SudeepBharghav/05.02 TopupSessions- Day05 - file1.py - Bag of words
module_x1_TopUpSessions/TopUpSessions_Notes SudeepBharghav/05.02 TopupSessions- Day05 - file1.py - Word2Vec model
module_x1_TopUpSessions/TopUpSessions_Notes SudeepBharghav/05.03 TopupSessions- Day05 - word2vect.py
Statistical analysis
- Bike data analysis
module_6_AdvancedAnalyticsUsingStatistics/AdvancedAnalyticsUsingStatistics_Assignments CDAC/03.04 vineeta_assignment.py
Other components
- Course user
- Job user
- Input data
- Output files
- Text sample
- Bike dataset
Connections 22
- Course user → Bank console: uses menu
module_4_OOPJ8/OOPJ8_Notes MalkeetSingh/07.02 Bank.java - Course user → Java exercises: runs examples
- Job user → City averages: runs job
- Job user → Custom partition job: runs job
module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MyPartitioner.java - Job user → Map-side join: runs job
module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapJoin.java - Job user → Inner map join: runs job
module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapInnerJoin.java - Job user → Reduce-side join: runs job
- Input data → City averages: reads input
- City averages → Output files: writes output
- Input data → Custom partition job: reads input
module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MyPartitioner.java - Custom partition job → Output files: writes output
module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MyPartitioner.java - Input data → Map-side join: reads input
module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapJoin.java - Map-side join → Output files: writes output
module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapJoin.java - Input data → Inner map join: reads input
module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapInnerJoin.java - Inner map join → Map-side join: references class
module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapInnerJoin.java - Inner map join → Output files: writes output
module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapInnerJoin.java - Input data → Reduce-side join: reads inputs
- Reduce-side join → Output files: writes output
- Text sample → Text preparation: preprocesses
module_x1_TopUpSessions/TopUpSessions_Notes SudeepBharghav/05.02 TopupSessions- Day05 - file1.py - Text preparation → Bag of words: vectorizes
module_x1_TopUpSessions/TopUpSessions_Notes SudeepBharghav/05.02 TopupSessions- Day05 - file1.py - Text sample → Word2Vec model: trains model
module_x1_TopUpSessions/TopUpSessions_Notes SudeepBharghav/05.03 TopupSessions- Day05 - word2vect.py - Bike dataset → Bike data analysis: loads dataset
module_6_AdvancedAnalyticsUsingStatistics/AdvancedAnalyticsUsingStatistics_Assignments CDAC/03.04 vineeta_assignment.py