How matdotviguier/histdata-fx-1-minute-data works
This repository provides a HistData historical-market-data downloader, a bulk FX-pair download workflow, and a standalone timestamp-shifting utility. The main workflow selects a pair, period, platform, and timeframe; requests HistData’s download page and archive; then saves the ZIP locally. README-documented data formats and instrument coverage are represented as capabilities, but their dataset generation is not otherwise sampled. Edges reflect the sampled API and bulk script; the conversion utility is independent.
Main entry points: api.py Download API · download_all_fx_data.py Bulk downloader · convert_est_to_target_time.py Timestamp converter · pairs.csv Pair catalog
Components 13
Data download
- Bulk downloader
download_all_fx_data.py - Pair catalog
pairs.csv - Download API
histdata/api.py - Format routing
histdata/api.py - Download page
histdata/api.py - Archive retrieval
histdata/api.py
Local datasets
- Downloaded archives
- Market data
Data utility
- Timestamp converter
convert_est_to_target_time.py - Input CSV
- Shifted CSV
Other components
- Data user
- HistData service
Connections 15
- Data user → Download API: requests data
- Data user → Bulk downloader: starts bulk download
- Bulk downloader → Pair catalog: reads pairs
- Bulk downloader → Download API: requests archives
- Download API → Format routing: selects endpoint
- Download API → Download page: fetches page
- Download page → HistData service: requests page
- Download page → Archive retrieval: provides token
- Download API → Archive retrieval: posts download request
- Archive retrieval → HistData service: requests archive
- Archive retrieval → Downloaded archives: writes ZIP
- Data user → Timestamp converter: runs conversion
- Timestamp converter → Input CSV: reads CSV
- Timestamp converter → Shifted CSV: writes shifted CSV
- Downloaded archives → Market data: contains downloaded data