How sevenlabs-hq/carbon works
Carbon is a Rust framework for Solana indexers: datasources supply live, historical, or snapshot updates; the core runtime filters and routes them through typed decoders to processors and sinks. The README documents this modular workflow and the Postgres, GraphQL, and metrics capabilities. The sampled pipeline excerpt confirms task-based datasource consumption and dispatch to update pipes; most datasource and decoder internals were not sampled, so their implementation-level links are not inferred.
Main entry points: pipeline.rs Pipeline runtime · datasources Datasource adapters · lib.rs Program decoders · instruction.rs Instruction decoding
Components 24
Data ingestion
- Datasource adapters
datasources - Geyser streams
datasources/yellowstone-grpc-datasource/src/lib.rs - RPC sources
datasources/rpc-block-subscribe-datasource/src/lib.rs - Backfill and snapshots
datasources/validator-snapshot-datasource/src/lib.rs - Message adapters
datasources/stream-message-datasource/src/lib.rs
Core runtime
- Pipeline runtime
crates/core/src/pipeline.rs - Update filters
crates/core/src/filter.rs - Instruction decoding
crates/core/src/instruction.rs - Processors
crates/core/src/processor.rs
Decoding
- Program decoders
decoders/boop-decoder/src/lib.rs - Account decoding
decoders/address-lookup-table-decoder/src/accounts/address_lookup_table.rs - Event decoding
decoders/boop-decoder/src/events/mod.rs
Storage and outputs
- Boop Postgres rows
decoders/boop-decoder/src/accounts/postgres/bonding_curve_row.rs - Config row
decoders/boop-decoder/src/accounts/postgres/config_row.rs - Config update row
decoders/boop-decoder/src/instructions/postgres/update_config_row.rs - Drift Postgres rows
decoders/drift-v2-decoder/src/accounts/postgres - Postgres processors
crates/core/src/postgres/processors.rs - Postgres database
Query and metrics
- GraphQL helpers
crates/core/src/graphql/server.rs - Decoder queries
decoders/drift-v2-decoder/src/graphql/query.rs - Pipeline metrics
crates/core/src/metrics.rs - Metrics exporters
crates/core/src/pipeline.rs - Prometheus
Other components
- Indexer application
Connections 25
- Indexer application → Pipeline runtime: configures
- Indexer application → Datasource adapters: selects
- Datasource adapters → Geyser streams: includes
- Datasource adapters → RPC sources: includes
- Datasource adapters → Backfill and snapshots: includes
- Datasource adapters → Message adapters: includes
- Pipeline runtime → Datasource adapters: consumes updates
crates/core/src/pipeline.rs - Pipeline runtime → Update filters: routes through
- Pipeline runtime → Instruction decoding: dispatches
crates/core/src/pipeline.rs - Instruction decoding → Program decoders: decodes typed data
- Program decoders → Account decoding: decodes accounts
- Program decoders → Event decoding: decodes events
- Pipeline runtime → Processors: dispatches output
- Processors → Postgres processors: persists through
crates/core/src/postgres/processors.rs - Postgres processors → Postgres database: writes rows
- Boop Postgres rows → Postgres database: defines stored rows
- Config row → Postgres database: defines stored rows
- Config update row → Postgres database: defines stored rows
- Drift Postgres rows → Postgres database: defines stored rows
- Postgres database → Decoder queries: queried by
decoders/drift-v2-decoder/src/graphql/query.rs - Decoder queries → GraphQL helpers: exposes query data
- Indexer application → GraphQL helpers: exposes indexed data
- Pipeline runtime → Pipeline metrics: registers metrics
crates/core/src/pipeline.rs - Pipeline runtime → Metrics exporters: initializes exporters
crates/core/src/pipeline.rs - Pipeline metrics → Prometheus: exports optionally