# wutaghost/llmscore-iclr-openreview architecture

> Architecture diagram of the GitHub repository wutaghost/llmscore-iclr-openreview, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-09-28). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/wutaghost/llmscore-iclr-openreview
- Repository: https://github.com/wutaghost/llmscore-iclr-openreview

## Overview

This repository is a static peer-review analysis dataset, not an executable scoring pipeline. Its main workflow is for researchers to load year-specific paper, review, and rationale records, then link review-level calibration variables to extracted paper text using the text index and stable paper IDs. The README documents anchor scores and residuals as released analysis fields. No source excerpts were available, so the graph reflects documented dataset contents and links rather than inferred processing code.

Main entry points: [`data/ICLR_2023/paper_text_index.jsonl.gz`](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2023/paper_text_index.jsonl.gz) (2023 text index), [`data/ICLR_2024/paper_text_index.jsonl.gz`](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2024/paper_text_index.jsonl.gz) (2024 text index), [`data/ICLR_2025/paper_text_index.jsonl.gz`](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2025/paper_text_index.jsonl.gz) (2025 text index), [`texts/ICLR_2023.tar.gz`](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/texts/ICLR_2023.tar.gz) (2023 text archive)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_records["Yearly review records"]
  node_papers23["2023 papers<br/>[papers.jsonl.gz]"]
  node_reviews23["2023 reviews<br/>[reviews.jsonl.gz]"]
  node_items23["2023 rationale items"]
  node_index23["2023 text index"]
  node_papers24["2024 papers<br/>[papers.jsonl.gz]"]
  node_reviews24["2024 reviews<br/>[reviews.jsonl.gz]"]
  node_items24["2024 rationale items"]
  node_index24["2024 text index"]
  node_papers25["2025 papers<br/>[papers.jsonl.gz]"]
  node_reviews25["2025 reviews<br/>[reviews.jsonl.gz]"]
  node_items25["2025 rationale items"]
  node_index25["2025 text index"]
end

subgraph group_texts["Extracted paper text"]
  node_text23["2023 text archive<br/>[ICLR_2023.tar.gz]"]
  node_text24["2024 text archive<br/>[ICLR_2024.tar.gz]"]
  node_text25["2025 text archive<br/>[ICLR_2025.tar.gz]"]
end

subgraph group_metadata["Release metadata"]
  node_schema["Field schema<br/>[schema.json]"]
  node_summary["Dataset summary"]
  node_manifests["Text manifests"]
  node_conversion["Conversion reports"]
end

node_researcher(("Researcher"))

node_researcher -->|"loads"| node_papers23
node_researcher -->|"loads"| node_reviews23
node_researcher -->|"loads"| node_items23
node_researcher -->|"loads"| node_index23
node_researcher -->|"loads"| node_papers24
node_researcher -->|"loads"| node_reviews24
node_researcher -->|"loads"| node_items24
node_researcher -->|"loads"| node_index24
node_researcher -->|"loads"| node_papers25
node_researcher -->|"loads"| node_reviews25
node_researcher -->|"loads"| node_items25
node_researcher -->|"loads"| node_index25
node_index23 -->|"locates text"| node_text23
node_index24 -->|"locates text"| node_text24
node_index25 -->|"locates text"| node_text25
node_researcher -->|"reads"| node_text23
node_researcher -->|"reads"| node_text24
node_researcher -->|"reads"| node_text25
node_researcher -->|"consults"| node_schema
node_researcher -->|"consults"| node_summary
node_researcher -->|"consults"| node_manifests
node_researcher -->|"consults"| node_conversion

click node_papers23 "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2023/papers.jsonl.gz"
click node_reviews23 "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2023/reviews.jsonl.gz"
click node_items23 "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2023/anonymized_items.jsonl.gz"
click node_index23 "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2023/paper_text_index.jsonl.gz"
click node_papers24 "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2024/papers.jsonl.gz"
click node_reviews24 "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2024/reviews.jsonl.gz"
click node_items24 "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2024/anonymized_items.jsonl.gz"
click node_index24 "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2024/paper_text_index.jsonl.gz"
click node_papers25 "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2025/papers.jsonl.gz"
click node_reviews25 "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2025/reviews.jsonl.gz"
click node_items25 "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2025/anonymized_items.jsonl.gz"
click node_index25 "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2025/paper_text_index.jsonl.gz"
click node_text23 "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/texts/ICLR_2023.tar.gz"
click node_text24 "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/texts/ICLR_2024.tar.gz"
click node_text25 "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/texts/ICLR_2025.tar.gz"
click node_schema "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/metadata/schema.json"
click node_summary "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/metadata/dataset_summary.json"
click node_manifests "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/metadata/ICLR_2023/paper_text_manifest.jsonl"
click node_conversion "https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/metadata/ICLR_2023/conversion_report.json"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_papers23,node_reviews23,node_items23,node_index23,node_papers24,node_reviews24,node_items24,node_index24,node_papers25,node_reviews25,node_items25,node_index25 toneBlue
class node_text23,node_text24,node_text25 toneAmber
class node_schema,node_summary,node_manifests,node_conversion toneMint
class node_researcher toneIndigo
```

## Components

### Yearly review records

- [2023 papers](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2023/papers.jsonl.gz): `data/ICLR_2023/papers.jsonl.gz`
- [2023 reviews](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2023/reviews.jsonl.gz): `data/ICLR_2023/reviews.jsonl.gz`
- [2023 rationale items](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2023/anonymized_items.jsonl.gz): `data/ICLR_2023/anonymized_items.jsonl.gz`
- [2023 text index](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2023/paper_text_index.jsonl.gz): `data/ICLR_2023/paper_text_index.jsonl.gz`
- [2024 papers](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2024/papers.jsonl.gz): `data/ICLR_2024/papers.jsonl.gz`
- [2024 reviews](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2024/reviews.jsonl.gz): `data/ICLR_2024/reviews.jsonl.gz`
- [2024 rationale items](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2024/anonymized_items.jsonl.gz): `data/ICLR_2024/anonymized_items.jsonl.gz`
- [2024 text index](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2024/paper_text_index.jsonl.gz): `data/ICLR_2024/paper_text_index.jsonl.gz`
- [2025 papers](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2025/papers.jsonl.gz): `data/ICLR_2025/papers.jsonl.gz`
- [2025 reviews](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2025/reviews.jsonl.gz): `data/ICLR_2025/reviews.jsonl.gz`
- [2025 rationale items](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2025/anonymized_items.jsonl.gz): `data/ICLR_2025/anonymized_items.jsonl.gz`
- [2025 text index](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/data/ICLR_2025/paper_text_index.jsonl.gz): `data/ICLR_2025/paper_text_index.jsonl.gz`

### Extracted paper text

- [2023 text archive](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/texts/ICLR_2023.tar.gz): `texts/ICLR_2023.tar.gz`
- [2024 text archive](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/texts/ICLR_2024.tar.gz): `texts/ICLR_2024.tar.gz`
- [2025 text archive](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/texts/ICLR_2025.tar.gz): `texts/ICLR_2025.tar.gz`

### Release metadata

- [Field schema](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/metadata/schema.json): `metadata/schema.json`
- [Dataset summary](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/metadata/dataset_summary.json): `metadata/dataset_summary.json`
- [Text manifests](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/metadata/ICLR_2023/paper_text_manifest.jsonl): `metadata/ICLR_2023/paper_text_manifest.jsonl`
- [Conversion reports](https://github.com/wutaghost/llmscore-iclr-openreview/blob/main/metadata/ICLR_2023/conversion_report.json): `metadata/ICLR_2023/conversion_report.json`

### Other components

- **Researcher**

## Connections

- Researcher → 2023 papers: loads
- Researcher → 2023 reviews: loads
- Researcher → 2023 rationale items: loads
- Researcher → 2023 text index: loads
- Researcher → 2024 papers: loads
- Researcher → 2024 reviews: loads
- Researcher → 2024 rationale items: loads
- Researcher → 2024 text index: loads
- Researcher → 2025 papers: loads
- Researcher → 2025 reviews: loads
- Researcher → 2025 rationale items: loads
- Researcher → 2025 text index: loads
- 2023 text index → 2023 text archive: locates text
- 2024 text index → 2024 text archive: locates text
- 2025 text index → 2025 text archive: locates text
- Researcher → 2023 text archive: reads
- Researcher → 2024 text archive: reads
- Researcher → 2025 text archive: reads
- Researcher → Field schema: consults
- Researcher → Dataset summary: consults
- Researcher → Text manifests: consults
- Researcher → Conversion reports: consults
