How nsqio/nsq works
NSQ is a distributed messaging platform: producers publish to nsqd, consumers receive messages, and nsqlookupd provides discovery; nsqadmin provides operational visibility and controls. The graph retains the distinct broker, lookup, administration, and client-tooling domains, plus the shared cluster-information layer. The tree and excerpts support the admin routing and broker client/auth details; most broker internals and several documented utility integrations were not sampled, so uncertain links are omitted or marked unverified.
Main entry points: nsqd.go Queue broker · app.js Admin web app · nsqlookupd.go Lookup service · http.go Admin server
Components 28
Message broker
- Queue broker
nsqd/nsqd.go - Client protocol
nsqd/protocol_v2.go - Client connection
nsqd/client_v2.go - Topic queues
nsqd/topic.go - Consumer channels
nsqd/channel.go - Disk queue
nsqd/backend_queue.go
Service discovery
- Lookup service
nsqlookupd/nsqlookupd.go - Producer registry
nsqlookupd/registration_db.go - Lookup protocol
nsqlookupd/lookup_protocol_v1.go
Operations console
- Admin server
nsqadmin/http.go - Admin web app
nsqadmin/static/js/views/app.js - Admin routing
nsqadmin/static/js/router.js - Admin state
nsqadmin/static/js/app_state.js - Admin views
nsqadmin/static/js/views/base.js
Client tools
- File output
apps/nsq_to_file/nsq_to_file.go - HTTP output
apps/nsq_to_http/nsq_to_http.go - NSQ relay
apps/nsq_to_nsq/nsq_to_nsq.go - Tail consumer
apps/nsq_tail/nsq_tail.go - Statistics tool
apps/nsq_stat/nsq_stat.go - CLI publisher
apps/to_nsq/to_nsq.go
Shared services
- Cluster information
internal/clusterinfo/data.go - Authorization
internal/auth/authorizations.go
Other components
- Message producer
- Message consumer
- Broker operator
- Service operator
- Administrator
- Graphite
Connections 30
- Message producer → Queue broker: publishes messages
- Queue broker → Client protocol: serves protocol
- Client protocol → Client connection: handles connection
- Client connection → Authorization: queries authorization
nsqd/client_v2.go - Queue broker → Topic queues: manages topics
- Topic queues → Consumer channels: delivers messages
- Topic queues → Disk queue: persists messages
- Consumer channels → Message consumer: delivers messages
- Queue broker → Lookup service: registers producers
- Lookup service → Lookup protocol: serves discovery
- Lookup service → Producer registry: tracks producers
- Administrator → Admin web app: operates
- Admin web app → Admin routing: starts routing
nsqadmin/static/js/main.js - Admin routing → Admin web app: dispatches views
nsqadmin/static/js/router.js - Admin web app → Admin views: renders views
nsqadmin/static/js/views/app.js - Admin web app → Admin state: reads settings
nsqadmin/static/js/views/app.js - Admin web app → Admin server: requests API
- Admin server → Cluster information: queries cluster
nsqadmin/http.go - Cluster information → Lookup service: queries producers
- Cluster information → Queue broker: queries stats
- Admin server → Graphite: proxies metrics
nsqadmin/http.go - Broker operator → Queue broker: starts broker
- Service operator → Lookup service: starts service
- Administrator → Admin server: administers cluster
- File output → Queue broker: consumes messages
- HTTP output → Queue broker: consumes messages
- NSQ relay → Queue broker: relays messages
- Tail consumer → Queue broker: consumes messages
- Statistics tool → Cluster information: collects stats
apps/nsq_stat/nsq_stat.go - CLI publisher → Queue broker: publishes messages