How wutaghost/llmscore-iclr-openreview works
This repository is a static peer-review analysis dataset, not an executable scoring pipeline. Its main workflow is for researchers to load year-specific paper, review, and rationale records, then link review-level calibration variables to extracted paper text using the text index and stable paper IDs. The README documents anchor scores and residuals as released analysis fields. No source excerpts were available, so the graph reflects documented dataset contents and links rather than inferred processing code.
Main entry points: ICLR_2023/paper_text_index.jsonl.gz 2023 text index · ICLR_2024/paper_text_index.jsonl.gz 2024 text index · ICLR_2025/paper_text_index.jsonl.gz 2025 text index · ICLR_2023.tar.gz 2023 text archive
Components 20
Yearly review records
- 2023 papers
data/ICLR_2023/papers.jsonl.gz - 2023 reviews
data/ICLR_2023/reviews.jsonl.gz - 2023 rationale items
data/ICLR_2023/anonymized_items.jsonl.gz - 2023 text index
data/ICLR_2023/paper_text_index.jsonl.gz - 2024 papers
data/ICLR_2024/papers.jsonl.gz - 2024 reviews
data/ICLR_2024/reviews.jsonl.gz - 2024 rationale items
data/ICLR_2024/anonymized_items.jsonl.gz - 2024 text index
data/ICLR_2024/paper_text_index.jsonl.gz - 2025 papers
data/ICLR_2025/papers.jsonl.gz - 2025 reviews
data/ICLR_2025/reviews.jsonl.gz - 2025 rationale items
data/ICLR_2025/anonymized_items.jsonl.gz - 2025 text index
data/ICLR_2025/paper_text_index.jsonl.gz
Extracted paper text
- 2023 text archive
texts/ICLR_2023.tar.gz - 2024 text archive
texts/ICLR_2024.tar.gz - 2025 text archive
texts/ICLR_2025.tar.gz
Release metadata
- Field schema
metadata/schema.json - Dataset summary
metadata/dataset_summary.json - Text manifests
metadata/ICLR_2023/paper_text_manifest.jsonl - Conversion reports
metadata/ICLR_2023/conversion_report.json
Other components
- Researcher
Connections 22
- Researcher → 2023 papers: loads
- Researcher → 2023 reviews: loads
- Researcher → 2023 rationale items: loads
- Researcher → 2023 text index: loads
- Researcher → 2024 papers: loads
- Researcher → 2024 reviews: loads
- Researcher → 2024 rationale items: loads
- Researcher → 2024 text index: loads
- Researcher → 2025 papers: loads
- Researcher → 2025 reviews: loads
- Researcher → 2025 rationale items: loads
- Researcher → 2025 text index: loads
- 2023 text index → 2023 text archive: locates text
- 2024 text index → 2024 text archive: locates text
- 2025 text index → 2025 text archive: locates text
- Researcher → 2023 text archive: reads
- Researcher → 2024 text archive: reads
- Researcher → 2025 text archive: reads
- Researcher → Field schema: consults
- Researcher → Dataset summary: consults
- Researcher → Text manifests: consults
- Researcher → Conversion reports: consults