How streamnative/examples works
This repository is a curated collection of messaging and event-streaming demos, not one integrated application. Its principal workflow is to configure a client, produce events to a broker, and consume or administer them; the taxi utility adds a distinct CSV-download, parse, and publish workflow. Kafka examples also cover serialization, consumer groups, and transactions. README-listed capabilities without corresponding files in the supplied tree are omitted; sampled source supports the specific wiring shown here, while other demo branches are inferred only from filenames.
Main entry points: cloud_kafka Kafka client demos · cloud Cloud Pulsar clients · main.go Taxi ingestion CLI · client.go OAuth client setup
Components 20
Pulsar demos
- Cloud Pulsar clients
cloud - TLS Pulsar clients
tls - AMQP 0-9-1 clients
aop/amqp091-go - OAuth client setup
cloud/go/ccloud/client.go - Pulsar producers
cloud/go/sampleProducer.go - Pulsar consumers
cloud/go/sampleConsumer.go
Kafka demos
- Kafka client demos
cloud_kafka - Producer examples
cloud_kafka/sarama/produce/main.go - Consumer groups
cloud_kafka/sarama/consumergroup/main.go - Topic administration
cloud_kafka/confluent-kafka-go/admin_create_topic - Schema formats
cloud_kafka/confluent-kafka-go/avro_generic_producer_example - Transactional examples
cloud_kafka/sarama/exactly_once/main.go - HTTP event logging
cloud_kafka/sarama/http_server/main.go
Data ingestion
- Taxi ingestion CLI
nyctaxi/taxidata/main.go - Taxi record schemas
nyctaxi/taxidata/pkg/types
Other components
- Demo user
- Pulsar service
- OAuth identity provider
- Kafka cluster
- NYC taxi CSV data
Connections 28
- Demo user → Cloud Pulsar clients: runs demos
- Demo user → TLS Pulsar clients: runs demos
- Demo user → AMQP 0-9-1 clients: runs demos
- Cloud Pulsar clients → OAuth client setup: creates client
- OAuth client setup → OAuth identity provider: requests credentials
- OAuth client setup → Pulsar service: connects
- Cloud Pulsar clients → Pulsar producers: includes
- Cloud Pulsar clients → Pulsar consumers: includes
- Pulsar producers → Pulsar service: publishes messages
- Pulsar service → Pulsar consumers: delivers messages
- TLS Pulsar clients → Pulsar service: connects securely
- AMQP 0-9-1 clients → Pulsar service: connects
- Demo user → Kafka client demos: runs demos
- Kafka client demos → Producer examples: includes
- Kafka client demos → Consumer groups: includes
- Kafka client demos → Topic administration: includes
- Kafka client demos → Schema formats: includes
- Kafka client demos → Transactional examples: includes
- Producer examples → Kafka cluster: publishes messages
- Kafka cluster → Consumer groups: delivers messages
- Topic administration → Kafka cluster: administers topics
- Schema formats → Kafka cluster: publishes records
- Transactional examples → Kafka cluster: transacts messages
- HTTP event logging → Kafka cluster: writes events
- Demo user → Taxi ingestion CLI: runs ingestion
- Taxi ingestion CLI → NYC taxi CSV data: downloads CSV
- Taxi ingestion CLI → Taxi record schemas: uses schemas
- Taxi ingestion CLI → Pulsar service: publishes records