# ye-kyaw-thu/mypos architecture

> Architecture diagram of the GitHub repository ye-kyaw-thu/mypos, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-08). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/ye-kyaw-thu/mypos
- Repository: https://github.com/ye-kyaw-thu/mypos

## Overview

myPOS is a manually segmented and POS-tagged Myanmar corpus, accompanied by validation, tag conversion, and research model implementations. The user-facing research workflow is to prepare corpus examples, train or decode a tagger, and evaluate its predictions. The sampled NCRF++ code shows data preparation and model composition; the README documents corpus segmentation and the tag set. The graph preserves the listed model families and conversion utility, but their detailed runtime links are not inferred where source excerpts are unavailable.

Main entry points: [`corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/main.py`](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/main.py) (NCRF++ 50% run), [`corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/2_NCRFPP_with_otest_100%_ASEAN/main.py`](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/2_NCRFPP_with_otest_100%25_ASEAN/main.py) (NCRF++ 100% run), [`corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/utils/data.py`](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/utils/data.py) (Data preparation), [`corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/model/seqlabel.py`](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/model/seqlabel.py) (Sequence labeler)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_corpus["Corpus and tags"]
  node_mypos["myPOS corpus"]
end

subgraph group_experiments["Tagging experiments"]
  node_draft_hmm["Draft HMM evaluation<br/>[evaluate.py]"]
  node_draft_crf["Draft CRF evaluation<br/>[evaluate.py]"]
  node_draft_kytea["KyTea evaluation<br/>[evaluate.py]"]
  node_draft_lowres["Low-resource evaluation<br/>[evaluate.py]"]
  node_draft_maxent["MaxEnt evaluation<br/>[evaluate.py]"]
  node_draft_rdr["Draft RDR evaluation<br/>[evaluate.py]"]
  node_paper_rdr["RDR evaluations<br/>[evaluate.py]"]
  node_paper_crf["CRF evaluations<br/>[evaluate.py]"]
  node_paper_hmm["HMM evaluations<br/>[evaluate.py]"]
  node_ncrf50["NCRF++ 50% run<br/>[main.py]"]
  node_ncrf100["NCRF++ 100% run<br/>[main.py]"]
  node_eval3["Version 3 HMM evaluation<br/>[evaluate.py]"]
  node_evalncrf["Version 3 NCRF evaluation<br/>[evaluate.py]"]
  node_evaltrained["Trained NCRF evaluation<br/>[evaluate.py]"]
  node_evalcrf["Version 3 CRF evaluation<br/>[evaluate.py]"]
  node_evalrdr["Version 3 RDR evaluation<br/>[evaluate.py]"]
end

subgraph group_ncrf["NCRF++ internals"]
  node_ncrf_data["Data preparation<br/>[data.py]"]
  node_ncrf_functions["Instance encoding<br/>[functions.py]"]
  node_alphabet["Token alphabets<br/>[alphabet.py]"]
  node_seq_label["Sequence labeler<br/>[seqlabel.py]"]
  node_sentence_classifier["Sentence classifier<br/>[sentclassifier.py]"]
  node_word_sequence["Word sequence encoder<br/>[wordsequence.py]"]
  node_word_rep["Word representations<br/>[wordrep.py]"]
  node_crf["CRF decoder<br/>[crf.py]"]
  node_metrics["Tag metrics<br/>[metric.py]"]
end

subgraph group_utilities["Corpus utilities"]
  node_validator["Corpus validator"]
  node_upos["UPOS converter<br/>[mypos2upos.py]"]
end

node_researcher(("NLP researcher"))

node_researcher -->|"uses"| node_mypos
node_researcher -->|"runs experiments"| node_ncrf50
node_ncrf50 -->|"prepares data"| node_ncrf_data
node_ncrf50 -->|"uses labeler"| node_seq_label
node_ncrf50 -->|"uses classifier"| node_sentence_classifier
node_ncrf50 -->|"scores predictions"| node_metrics
node_ncrf100 -->|"prepares data"| node_ncrf_data
node_ncrf100 -->|"uses labeler"| node_seq_label
node_ncrf100 -->|"uses classifier"| node_sentence_classifier
node_ncrf100 -->|"scores predictions"| node_metrics
node_ncrf_data -->|"uses alphabets"| node_alphabet
node_ncrf_data -->|"encodes instances"| node_ncrf_functions
node_seq_label -->|"encodes sequence"| node_word_sequence
node_seq_label -->|"decodes tags"| node_crf
node_sentence_classifier -->|"encodes sentence"| node_word_sequence
node_word_sequence -->|"builds representations"| node_word_rep
node_mypos -.->|"validates corpus"| node_validator
node_mypos -.->|"converts tags"| node_upos

click node_validator "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/etc/pos_corpus_validator.py"
click node_upos "https://github.com/ye-kyaw-thu/mypos/blob/master/myPOS-to-universalPOS/mypos2upos.py"
click node_draft_hmm "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-draft-ver-1.0/model/3gHMM/evaluate.py"
click node_draft_crf "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-draft-ver-1.0/model/crf/evaluate.py"
click node_draft_kytea "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-draft-ver-1.0/model/kytea/evaluate.py"
click node_draft_lowres "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-draft-ver-1.0/model/low-resource-pos-tagging-2014/evaluate.py"
click node_draft_maxent "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-draft-ver-1.0/model/maxent/evaluate.py"
click node_draft_rdr "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-draft-ver-1.0/model/rdr/evaluate.py"
click node_paper_rdr "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/1_RDR/1_RDR_with_otest_50%25_ASEAN_Corpus/evaluate.py"
click node_paper_crf "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/2_CRF/1_CRF_with_otest_50%25_ASEAN_Corpus/evaluate.py"
click node_paper_hmm "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/3_HMM/1_HMM_with_otest_50%25_ASEAN_Corpus/evaluate.py"
click node_ncrf50 "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/main.py"
click node_ncrf100 "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/2_NCRFPP_with_otest_100%25_ASEAN/main.py"
click node_ncrf_data "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/utils/data.py"
click node_ncrf_functions "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/utils/functions.py"
click node_alphabet "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/utils/alphabet.py"
click node_seq_label "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/model/seqlabel.py"
click node_sentence_classifier "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/model/sentclassifier.py"
click node_word_sequence "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/model/wordsequence.py"
click node_word_rep "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/model/wordrep.py"
click node_crf "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/model/crf.py"
click node_metrics "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/utils/metric.py"
click node_eval3 "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/models/3gHMM_mypos-ver3/evaluate.py"
click node_evalncrf "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/models/NCRFpp_mypos-ver3/evaluate.py"
click node_evaltrained "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/models/NCRFpp_mypos-ver3/trained-models/wordCNN-CRF-charLSTM/evaluate.py"
click node_evalcrf "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/models/crf_mypos-ver3/evaluate.py"
click node_evalrdr "https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/models/rdr_mypos-ver3/evaluate.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_mypos toneBlue
class node_draft_hmm,node_draft_crf,node_draft_kytea,node_draft_lowres,node_draft_maxent,node_draft_rdr,node_paper_rdr,node_paper_crf,node_paper_hmm,node_ncrf50,node_ncrf100,node_eval3,node_evalncrf,node_evaltrained,node_evalcrf,node_evalrdr toneAmber
class node_ncrf_data,node_ncrf_functions,node_alphabet,node_seq_label,node_sentence_classifier,node_word_sequence,node_word_rep,node_crf,node_metrics toneMint
class node_validator,node_upos toneRose
class node_researcher toneIndigo
```

## Components

### Corpus and tags

- **myPOS corpus**

### Tagging experiments

- [Draft HMM evaluation](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-draft-ver-1.0/model/3gHMM/evaluate.py): `corpus-draft-ver-1.0/model/3gHMM/evaluate.py`
- [Draft CRF evaluation](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-draft-ver-1.0/model/crf/evaluate.py): `corpus-draft-ver-1.0/model/crf/evaluate.py`
- [KyTea evaluation](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-draft-ver-1.0/model/kytea/evaluate.py): `corpus-draft-ver-1.0/model/kytea/evaluate.py`
- [Low-resource evaluation](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-draft-ver-1.0/model/low-resource-pos-tagging-2014/evaluate.py): `corpus-draft-ver-1.0/model/low-resource-pos-tagging-2014/evaluate.py`
- [MaxEnt evaluation](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-draft-ver-1.0/model/maxent/evaluate.py): `corpus-draft-ver-1.0/model/maxent/evaluate.py`
- [Draft RDR evaluation](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-draft-ver-1.0/model/rdr/evaluate.py): `corpus-draft-ver-1.0/model/rdr/evaluate.py`
- [RDR evaluations](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/1_RDR/1_RDR_with_otest_50%25_ASEAN_Corpus/evaluate.py): `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/1_RDR/1_RDR_with_otest_50%_ASEAN_Corpus/evaluate.py`
- [CRF evaluations](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/2_CRF/1_CRF_with_otest_50%25_ASEAN_Corpus/evaluate.py): `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/2_CRF/1_CRF_with_otest_50%_ASEAN_Corpus/evaluate.py`
- [HMM evaluations](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/3_HMM/1_HMM_with_otest_50%25_ASEAN_Corpus/evaluate.py): `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/3_HMM/1_HMM_with_otest_50%_ASEAN_Corpus/evaluate.py`
- [NCRF++ 50% run](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/main.py): `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/main.py`
- [NCRF++ 100% run](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/2_NCRFPP_with_otest_100%25_ASEAN/main.py): `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/2_NCRFPP_with_otest_100%_ASEAN/main.py`
- [Version 3 HMM evaluation](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/models/3gHMM_mypos-ver3/evaluate.py): `corpus-ver-3.0/models/3gHMM_mypos-ver3/evaluate.py`
- [Version 3 NCRF evaluation](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/models/NCRFpp_mypos-ver3/evaluate.py): `corpus-ver-3.0/models/NCRFpp_mypos-ver3/evaluate.py`
- [Trained NCRF evaluation](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/models/NCRFpp_mypos-ver3/trained-models/wordCNN-CRF-charLSTM/evaluate.py): `corpus-ver-3.0/models/NCRFpp_mypos-ver3/trained-models/wordCNN-CRF-charLSTM/evaluate.py`
- [Version 3 CRF evaluation](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/models/crf_mypos-ver3/evaluate.py): `corpus-ver-3.0/models/crf_mypos-ver3/evaluate.py`
- [Version 3 RDR evaluation](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/models/rdr_mypos-ver3/evaluate.py): `corpus-ver-3.0/models/rdr_mypos-ver3/evaluate.py`

### NCRF++ internals

- [Data preparation](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/utils/data.py): `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/utils/data.py`
- [Instance encoding](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/utils/functions.py): `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/utils/functions.py`
- [Token alphabets](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/utils/alphabet.py): `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/utils/alphabet.py`
- [Sequence labeler](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/model/seqlabel.py): `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/model/seqlabel.py`
- [Sentence classifier](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/model/sentclassifier.py): `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/model/sentclassifier.py`
- [Word sequence encoder](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/model/wordsequence.py): `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/model/wordsequence.py`
- [Word representations](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/model/wordrep.py): `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/model/wordrep.py`
- [CRF decoder](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/model/crf.py): `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/model/crf.py`
- [Tag metrics](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%25_ASEAN/utils/metric.py): `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/utils/metric.py`

### Corpus utilities

- [Corpus validator](https://github.com/ye-kyaw-thu/mypos/blob/master/corpus-ver-3.0/etc/pos_corpus_validator.py): `corpus-ver-3.0/etc/pos_corpus_validator.py`
- [UPOS converter](https://github.com/ye-kyaw-thu/mypos/blob/master/myPOS-to-universalPOS/mypos2upos.py): `myPOS-to-universalPOS/mypos2upos.py`

### Other components

- **NLP researcher**

## Connections

- NLP researcher → myPOS corpus: uses
- NLP researcher → NCRF++ 50% run: runs experiments (evidence: `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/main.py`)
- NCRF++ 50% run → Data preparation: prepares data (evidence: `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/main.py`)
- NCRF++ 50% run → Sequence labeler: uses labeler (evidence: `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/main.py`)
- NCRF++ 50% run → Sentence classifier: uses classifier (evidence: `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/main.py`)
- NCRF++ 50% run → Tag metrics: scores predictions (evidence: `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/main.py`)
- NCRF++ 100% run → Data preparation: prepares data (evidence: `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/2_NCRFPP_with_otest_100%_ASEAN/main.py`)
- NCRF++ 100% run → Sequence labeler: uses labeler (evidence: `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/2_NCRFPP_with_otest_100%_ASEAN/main.py`)
- NCRF++ 100% run → Sentence classifier: uses classifier (evidence: `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/2_NCRFPP_with_otest_100%_ASEAN/main.py`)
- NCRF++ 100% run → Tag metrics: scores predictions (evidence: `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/2_NCRFPP_with_otest_100%_ASEAN/main.py`)
- Data preparation → Token alphabets: uses alphabets (evidence: `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/utils/data.py`)
- Data preparation → Instance encoding: encodes instances (evidence: `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/utils/data.py`)
- Sequence labeler → Word sequence encoder: encodes sequence (evidence: `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/model/seqlabel.py`)
- Sequence labeler → CRF decoder: decodes tags (evidence: `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/model/seqlabel.py`)
- Sentence classifier → Word sequence encoder: encodes sentence (evidence: `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/model/sentclassifier.py`)
- Word sequence encoder → Word representations: builds representations (evidence: `corpus-ver-3.0/iSAI-NLP2020-paper-experiment/4_NCRFPP/1_NCRFPP_with_otest_50%_ASEAN/model/wordsequence.py`)
- myPOS corpus → Corpus validator: validates corpus
- myPOS corpus → UPOS converter: converts tags
