How confluentinc/workshop-data-contracts works
This repository is a hands-on data-contracts workshop, not an application runtime. Its documented workflow prototypes data production, schema governance and quality checks, routes valid and invalid records to separate destinations, and supports review and remediation. The tree identifies schema, generator and infrastructure assets, but no source excerpts were provided; the detailed processing flow below is therefore documented by the README, not verified in implementation. Infrastructure links are limited to those explicit workshop capabilities.
Main entry points: confluent.tf Schema Registry · data_contracts Quality rules · generators Data producers · clickstream_schema_v1.avsc Clickstream schemas
Components 16
Data production
- Data producers
data/generators - Generator configs
data/generators/clickstream_generator.json
Contract governance
- Data contracts
data/data_contracts - Clickstream schemas
data/data_contracts/schemas/clickstream_schema_v1.avsc - Schema evolution
data/data_contracts/schemas/clickstream_schema_v2.avsc - Schema Registry
terraform/confluent.tf - Quality rules
data/data_contracts
Stream processing
- Kafka topics
terraform/confluent.tf - Dead letter queue
terraform/confluent.tf - Downstream consumers
terraform/databricks.tf - Data steward
- Remediation
Workshop infrastructure
- AWS resources
terraform/aws_s3.tf - Generator infrastructure
terraform/data_generator.tf - Databricks workspace
terraform/databricks.tf
Other components
- Data engineer
Connections 13
- Data engineer → Data producers: creates data
README.md - Data producers → Schema Registry: registers schemas
README.md - Schema Registry → Quality rules: governs validation
README.md - Quality rules → Kafka topics: routes valid
README.md - Quality rules → Dead letter queue: routes invalid
README.md - Kafka topics → Downstream consumers: feeds consumers
README.md - Dead letter queue → Data steward: flags violations
README.md - Data steward → Remediation: reviews records
README.md - Remediation → Data producers: feeds fixes
README.md - Clickstream schemas → Schema Registry: defines contracts
README.md - Schema evolution → Schema Registry: evolves schemas
README.md - Data engineer → AWS resources: provisions environment
README.md - Data engineer → Databricks workspace: uses workspace
README.md