How gordonmurray/data-engineering-skills works
This repository is a catalog of Agent Skills, not a data-processing runtime. A user asks Claude for help in a covered domain; the relevant skill’s frontmatter provides trigger metadata, and its SKILL.md body supplies guidance on demand. The README documents use through Claude Code, Claude.ai uploads, and the Claude API. Individual skill contents were not sampled, so the graph shows catalog capabilities and documented loading relationships only.
Main entry points: iceberg/SKILL.md Apache Iceberg · paimon/SKILL.md Apache Paimon · lance/SKILL.md Lance · firn/SKILL.md Firn
Components 12
Data formats and search
- Apache Iceberg
iceberg/SKILL.md - Apache Paimon
paimon/SKILL.md - Lance
lance/SKILL.md - Firn
firn/SKILL.md
Streaming systems
- Apache Fluss
fluss/SKILL.md - Apache Flink
flink/SKILL.md - Apache Iggy
iggy/SKILL.md
Local orchestration
- Docker Compose
docker-compose/SKILL.md
Other components
- User
- Claude Code
- Claude.ai
- Claude API
Connections 12
- User → Claude Code: asks for help
- Claude Code → Apache Iceberg: loads on match
- Claude Code → Apache Paimon: loads on match
- Claude Code → Lance: loads on match
- Claude Code → Firn: loads on match
- Claude Code → Apache Fluss: loads on match
- Claude Code → Apache Flink: loads on match
- Claude Code → Apache Iggy: loads on match
- Claude Code → Docker Compose: loads on match
- User → Claude.ai: uploads skill
- User → Claude API: passes skill
- User → Apache Iceberg: references directly