How j-suyash/data-engineering-bible works
This repository is an offline, linked data-engineering interview knowledgebase, not an executable data platform. Its main user workflow is to choose a topic, practise its recitation prompts, and follow prerequisite/successor links; Obsidian, terminal search, and drill mode are documented ways to navigate it. The graph preserves the README’s topic taxonomy and documented prerequisite edges. Source excerpts were unavailable, so relationships are based on the README’s graph and usage descriptions only.
Main entry points: sql-semantics.md SQL semantics · sql-ddl-dml-transactions.md DDL and transactions · dimensional-modeling.md Dimensional modeling · warehouse-architecture.md Warehouse architecture
Components 34
SQL and modeling
- SQL semantics
nodes/sql-semantics.md - SQL joins
nodes/sql-joins-sets.md - SQL aggregation
nodes/sql-aggregation.md - DDL and transactions
nodes/sql-ddl-dml-transactions.md - CTEs and subqueries
nodes/sql-ctes-subqueries.md - Window functions
nodes/sql-window-functions.md - Query patterns
nodes/sql-query-patterns.md - SQL performance
nodes/sql-performance-indexing.md - Relational modeling
nodes/relational-modeling.md - Dimensional modeling
nodes/dimensional-modeling.md - OLTP and OLAP
nodes/oltp-vs-olap.md - SCD history
nodes/scd-history.md - Warehouse architecture
nodes/warehouse-architecture.md
Pipelines and streaming
- ETL and ELT
nodes/etl-vs-elt.md - Pipeline design
nodes/pipeline-design.md - Airflow orchestration
nodes/orchestration-airflow.md - dbt transformations
nodes/dbt-transformations.md - CDC ingestion
nodes/cdc-ingestion.md - Batch and streaming
nodes/batch-vs-streaming.md - Kafka messaging
nodes/kafka-messaging.md - Lambda and Kappa
nodes/lambda-kappa.md
Processing and storage
- Distributed systems
nodes/distributed-systems.md - Spark core
nodes/spark-core.md - Spark tuning
nodes/spark-tuning.md - Hadoop HDFS
nodes/hadoop-hdfs.md - MapReduce
nodes/mapreduce.md - Hive and Impala
nodes/hive-impala.md - File formats
nodes/file-formats.md - Partitioning layout
nodes/partitioning-layout.md - Lakehouse formats
nodes/table-formats-lakehouse.md - NoSQL stores
nodes/nosql-stores.md
Cloud and operations
- Cloud fundamentals
nodes/cloud-fundamentals.md - AWS data stack
nodes/aws-data-stack.md
Other components
- Interview learner
Connections 40
- Interview learner → DDL and transactions: starts with
README.md - Interview learner → Dimensional modeling: studies
README.md - Interview learner → SCD history: studies
README.md - Interview learner → Cloud fundamentals: studies
README.md - Interview learner → Warehouse architecture: navigates topics
README.md - SQL semantics → SQL joins: prerequisite
README.md - SQL semantics → SQL aggregation: prerequisite
README.md - SQL semantics → DDL and transactions: prerequisite
README.md - SQL semantics → CTEs and subqueries: prerequisite
README.md - SQL joins → SQL aggregation: prerequisite
README.md - SQL aggregation → Window functions: prerequisite
README.md - Window functions → Query patterns: prerequisite
README.md - CTEs and subqueries → Query patterns: prerequisite
README.md - SQL joins → SQL performance: prerequisite
README.md - DDL and transactions → SQL performance: prerequisite
README.md - DDL and transactions → Relational modeling: prerequisite
README.md - Relational modeling → Dimensional modeling: prerequisite
README.md - Relational modeling → OLTP and OLAP: prerequisite
README.md - Dimensional modeling → SCD history: prerequisite
README.md - Dimensional modeling → Warehouse architecture: prerequisite
README.md - OLTP and OLAP → Warehouse architecture: prerequisite
README.md - Warehouse architecture → ETL and ELT: prerequisite
README.md - ETL and ELT → Pipeline design: prerequisite
README.md - ETL and ELT → dbt transformations: prerequisite
README.md - Pipeline design → Airflow orchestration: prerequisite
README.md - Pipeline design → Batch and streaming: prerequisite
README.md - SCD history → CDC ingestion: prerequisite
README.md - CDC ingestion → Batch and streaming: prerequisite
README.md - Batch and streaming → Kafka messaging: prerequisite
README.md - Kafka messaging → Lambda and Kappa: prerequisite
README.md - Distributed systems → Spark core: prerequisite
README.md - Spark core → Spark tuning: prerequisite
README.md - Hadoop HDFS → MapReduce: prerequisite
README.md - Hadoop HDFS → Hive and Impala: prerequisite
README.md - MapReduce → Spark core: prerequisite
README.md - File formats → Partitioning layout: prerequisite
README.md - File formats → Lakehouse formats: prerequisite
README.md - Partitioning layout → Spark tuning: prerequisite
README.md - Distributed systems → NoSQL stores: prerequisite
README.md - Cloud fundamentals → AWS data stack: prerequisite
README.md