# donnemartin/data-science-ipython-notebooks architecture

> Architecture diagram of the GitHub repository donnemartin/data-science-ipython-notebooks, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-13). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/donnemartin/data-science-ipython-notebooks
- Repository: https://github.com/donnemartin/data-science-ipython-notebooks

## Overview

This repository is a curated collection of data-science and machine-learning notebook examples, not a single application. The principal user workflow is to choose a topic, follow its tutorial or example, and inspect or run the demonstration; the README describes the collection as IPython Notebook demonstrations. Source excerpts are uneven, so edges are limited to documented examples and explicit source references. Several README-listed areas are represented as collections because their notebook files are absent from this tree.

Main entry points: [`scipy/first.py`](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scipy/first.py) (Statistics example), [`scipy/thinkstats2.py`](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scipy/thinkstats2.py) (Statistical methods), [`scipy/nsfg.py`](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scipy/nsfg.py) (NSFG data), [`scipy/thinkplot.py`](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scipy/thinkplot.py) (Statistical plotting)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_deep_learning["Deep learning"]
  node_deep_learning_collection["Deep learning demos<br/>[data_helpers.py]"]
  node_keras_data["Text data helpers<br/>[data_helpers.py]"]
  node_word2vec["Word2Vec training<br/>[w2v.py]"]
  node_resnet["ResNet50 model<br/>[resnet50.py]"]
  node_vgg16["VGG16 model<br/>[vgg16.py]"]
  node_vgg19["VGG19 model<br/>[vgg19.py]"]
  node_mnist_data["MNIST input<br/>[input_data.py]"]
  node_lstm_text["Text LSTM<br/>[lstm_text.py]"]
  node_rnn_precompile["RNN precompile<br/>[rnn_precompile.py]"]
end

subgraph group_ml_examples["Machine learning"]
  node_sklearn_collection["Scikit-learn examples<br/>[figures.py]"]
  node_svm_gui["SVM visualizer<br/>[svm_gui.py]"]
  node_ml_figures["ML figures<br/>[figures.py]"]
  node_titanic_model["Titanic survival model"]
  node_churn_metrics["Churn measurements"]
end

subgraph group_statistics["Statistics"]
  node_thinkstats["Statistical methods<br/>[thinkstats2.py]"]
  node_thinkplot["Statistical plotting<br/>[thinkplot.py]"]
  node_nsfg["NSFG data<br/>[nsfg.py]"]
  node_statistics_example["Statistics example<br/>[first.py]"]
end

subgraph group_data_tools["Data tools"]
  node_python_transforms["Data transforms<br/>[transform_util.py]"]
  node_python_types["Data types<br/>[type_util.py]"]
  node_s3_parser["S3 log parser"]
end

node_learner(("Notebook user"))

node_learner -->|"explores demos"| node_deep_learning_collection
node_learner -->|"explores examples"| node_sklearn_collection
node_learner -->|"explores statistics"| node_statistics_example
node_word2vec -->|"loads data"| node_keras_data
node_statistics_example -->|"imports data"| node_nsfg
node_statistics_example -->|"imports methods"| node_thinkstats
node_statistics_example -->|"imports plotting"| node_thinkplot
node_nsfg -->|"imports methods"| node_thinkstats
node_thinkstats -->|"imports plotting"| node_thinkplot

click node_deep_learning_collection "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/keras-tutorial/data_helpers.py"
click node_keras_data "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/keras-tutorial/data_helpers.py"
click node_word2vec "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/keras-tutorial/w2v.py"
click node_resnet "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/keras-tutorial/deep_learning_models/resnet50.py"
click node_vgg16 "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/keras-tutorial/deep_learning_models/vgg16.py"
click node_vgg19 "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/keras-tutorial/deep_learning_models/vgg19.py"
click node_mnist_data "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/tensor-flow-examples/input_data.py"
click node_lstm_text "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/theano-tutorial/rnn_tutorial/lstm_text.py"
click node_rnn_precompile "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/theano-tutorial/rnn_tutorial/rnn_precompile.py"
click node_sklearn_collection "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scikit-learn/fig_code/figures.py"
click node_svm_gui "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scikit-learn/fig_code/svm_gui.py"
click node_ml_figures "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scikit-learn/fig_code/figures.py"
click node_titanic_model "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/data/titanic/genderclassmodel.py"
click node_churn_metrics "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/analyses/churn_measurements.py"
click node_thinkstats "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scipy/thinkstats2.py"
click node_thinkplot "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scipy/thinkplot.py"
click node_nsfg "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scipy/nsfg.py"
click node_statistics_example "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scipy/first.py"
click node_python_transforms "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/python-data/transform_util.py"
click node_python_types "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/python-data/type_util.py"
click node_s3_parser "https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/mapreduce/mr_s3_log_parser.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_deep_learning_collection,node_keras_data,node_word2vec,node_resnet,node_vgg16,node_vgg19,node_mnist_data,node_lstm_text,node_rnn_precompile,node_learner toneBlue
class node_sklearn_collection,node_svm_gui,node_ml_figures,node_titanic_model,node_churn_metrics toneAmber
class node_thinkstats,node_thinkplot,node_nsfg,node_statistics_example toneMint
class node_python_transforms,node_python_types,node_s3_parser toneRose
```

## Components

### Deep learning

- [Deep learning demos](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/keras-tutorial/data_helpers.py): `deep-learning/keras-tutorial/data_helpers.py`
- [Text data helpers](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/keras-tutorial/data_helpers.py): `deep-learning/keras-tutorial/data_helpers.py`
- [Word2Vec training](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/keras-tutorial/w2v.py): `deep-learning/keras-tutorial/w2v.py`
- [ResNet50 model](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/keras-tutorial/deep_learning_models/resnet50.py): `deep-learning/keras-tutorial/deep_learning_models/resnet50.py`
- [VGG16 model](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/keras-tutorial/deep_learning_models/vgg16.py): `deep-learning/keras-tutorial/deep_learning_models/vgg16.py`
- [VGG19 model](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/keras-tutorial/deep_learning_models/vgg19.py): `deep-learning/keras-tutorial/deep_learning_models/vgg19.py`
- [MNIST input](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/tensor-flow-examples/input_data.py): `deep-learning/tensor-flow-examples/input_data.py`
- [Text LSTM](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/theano-tutorial/rnn_tutorial/lstm_text.py): `deep-learning/theano-tutorial/rnn_tutorial/lstm_text.py`
- [RNN precompile](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/deep-learning/theano-tutorial/rnn_tutorial/rnn_precompile.py): `deep-learning/theano-tutorial/rnn_tutorial/rnn_precompile.py`

### Machine learning

- [Scikit-learn examples](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scikit-learn/fig_code/figures.py): `scikit-learn/fig_code/figures.py`
- [SVM visualizer](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scikit-learn/fig_code/svm_gui.py): `scikit-learn/fig_code/svm_gui.py`
- [ML figures](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scikit-learn/fig_code/figures.py): `scikit-learn/fig_code/figures.py`
- [Titanic survival model](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/data/titanic/genderclassmodel.py): `data/titanic/genderclassmodel.py`
- [Churn measurements](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/analyses/churn_measurements.py): `analyses/churn_measurements.py`

### Statistics

- [Statistical methods](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scipy/thinkstats2.py): `scipy/thinkstats2.py`
- [Statistical plotting](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scipy/thinkplot.py): `scipy/thinkplot.py`
- [NSFG data](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scipy/nsfg.py): `scipy/nsfg.py`
- [Statistics example](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/scipy/first.py): `scipy/first.py`

### Data tools

- [Data transforms](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/python-data/transform_util.py): `python-data/transform_util.py`
- [Data types](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/python-data/type_util.py): `python-data/type_util.py`
- [S3 log parser](https://github.com/donnemartin/data-science-ipython-notebooks/blob/master/mapreduce/mr_s3_log_parser.py): `mapreduce/mr_s3_log_parser.py`

### Other components

- **Notebook user**

## Connections

- Notebook user → Deep learning demos: explores demos
- Notebook user → Scikit-learn examples: explores examples
- Notebook user → Statistics example: explores statistics
- Word2Vec training → Text data helpers: loads data (evidence: `deep-learning/keras-tutorial/w2v.py`)
- Statistics example → NSFG data: imports data (evidence: `scipy/first.py`)
- Statistics example → Statistical methods: imports methods (evidence: `scipy/first.py`)
- Statistics example → Statistical plotting: imports plotting (evidence: `scipy/first.py`)
- NSFG data → Statistical methods: imports methods (evidence: `scipy/nsfg.py`)
- Statistical methods → Statistical plotting: imports plotting (evidence: `scipy/thinkstats2.py`)
