# apache/arrow-go architecture

> Architecture diagram of the GitHub repository apache/arrow-go, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-03). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/apache/arrow-go
- Repository: https://github.com/apache/arrow-go

## Overview

Apache Arrow Go provides columnar in-memory data structures and computation, with readers and writers for interchange formats, Parquet support, and Flight/FlightSQL transport. A typical workflow creates Arrow arrays or record batches, processes them with compute kernels, then serializes or transfers them. The graph includes the major format and service branches documented or represented in the tree. Some subsystem links are based on README capability statements or SOURCE INDEX references; unsampled implementation details are not assumed.

Main entry points: [`arrow/array/numericbuilder.gen.go`](https://github.com/apache/arrow-go/blob/main/arrow/array/numericbuilder.gen.go) (Arrays & Batches), [`parquet/pqarrow/column_readers.go`](https://github.com/apache/arrow-go/blob/main/parquet/pqarrow/column_readers.go) (Arrow-Parquet Bridge), [`arrow/compute/arithmetic.go`](https://github.com/apache/arrow-go/blob/main/arrow/compute/arithmetic.go) (Compute API), [`arrow/flight/client.go`](https://github.com/apache/arrow-go/blob/main/arrow/flight/client.go) (Flight RPC)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_core["Arrow Core"]
  node_types["Arrow Types"]
  node_arrays["Arrays &amp; Batches"]
  node_memory["Memory Management<br/>[allocator.go]"]
  node_bitmaps["Bitmap Utilities<br/>[bitmaps.go]"]
  node_scalars["Scalar Values<br/>[scalar.go]"]
  node_variant["Variant Extension<br/>[variant.go]"]
end

subgraph group_compute["Compute"]
  node_compute_api["Compute API<br/>[arithmetic.go]"]
  node_kernels["Compute Kernels"]
end

subgraph group_formats["Data Formats"]
  node_csv["CSV I/O<br/>[reader.go]"]
  node_ipc["Arrow IPC<br/>[reader.go]"]
  node_cdata["C Data Interface<br/>[cdata.go]"]
  node_avro["Avro Reader<br/>[reader.go]"]
  node_converter["Avro Converter<br/>[main.go]"]
end

subgraph group_parquet["Parquet"]
  node_pq_schema["Parquet Schema<br/>[reflection.go]"]
  node_pq_pages["Parquet Pages<br/>[page_reader.go]"]
  node_pq_stats["Parquet Statistics<br/>[statistics.go]"]
  node_pq_arrow["Arrow-Parquet Bridge<br/>[column_readers.go]"]
  node_pq_props["Writer Properties"]
end

subgraph group_services["Flight Services"]
  node_flight["Flight RPC<br/>[client.go]"]
  node_flightsql_client["FlightSQL Client<br/>[client.go]"]
  node_flightsql_server["FlightSQL Server<br/>[server.go]"]
end

node_user(("Go Application"))

node_user -->|"creates data"| node_arrays
node_arrays -->|"uses types"| node_types
node_arrays -->|"allocates buffers"| node_memory
node_arrays -->|"uses bitmaps"| node_bitmaps
node_user -->|"invokes operations"| node_compute_api
node_compute_api -->|"dispatches kernels"| node_kernels
node_compute_api -->|"uses values"| node_scalars
node_user -->|"reads or writes"| node_csv
node_user -->|"streams batches"| node_ipc
node_ipc -.->|"allocates buffers"| node_memory
node_user -->|"exchanges data"| node_cdata
node_converter -->|"reads records"| node_avro
node_converter -->|"writes batches"| node_pq_arrow
node_pq_arrow -.->|"configures writer"| node_pq_props
node_pq_arrow -->|"maps schemas"| node_pq_schema
node_pq_arrow -->|"reads pages"| node_pq_pages
node_pq_pages -->|"reads statistics"| node_pq_stats
node_user -->|"transfers batches"| node_flight
node_flightsql_client -->|"uses RPC client"| node_flight
node_flightsql_server -->|"routes RPC"| node_flight
node_user -->|"uses extension"| node_variant

click node_types "https://github.com/apache/arrow-go/blob/main/arrow/datatype_fixedwidth.go"
click node_arrays "https://github.com/apache/arrow-go/blob/main/arrow/array/numericbuilder.gen.go"
click node_memory "https://github.com/apache/arrow-go/blob/main/arrow/memory/allocator.go"
click node_bitmaps "https://github.com/apache/arrow-go/blob/main/arrow/bitutil/bitmaps.go"
click node_scalars "https://github.com/apache/arrow-go/blob/main/arrow/scalar/scalar.go"
click node_compute_api "https://github.com/apache/arrow-go/blob/main/arrow/compute/arithmetic.go"
click node_kernels "https://github.com/apache/arrow-go/blob/main/arrow/compute/internal/kernels/vector_selection.go"
click node_csv "https://github.com/apache/arrow-go/blob/main/arrow/csv/reader.go"
click node_ipc "https://github.com/apache/arrow-go/blob/main/arrow/ipc/reader.go"
click node_cdata "https://github.com/apache/arrow-go/blob/main/arrow/cdata/cdata.go"
click node_avro "https://github.com/apache/arrow-go/blob/main/arrow/avro/reader.go"
click node_converter "https://github.com/apache/arrow-go/blob/main/arrow/avro/avro2parquet/main.go"
click node_pq_schema "https://github.com/apache/arrow-go/blob/main/parquet/schema/reflection.go"
click node_pq_pages "https://github.com/apache/arrow-go/blob/main/parquet/file/page_reader.go"
click node_pq_stats "https://github.com/apache/arrow-go/blob/main/parquet/metadata/statistics.go"
click node_pq_arrow "https://github.com/apache/arrow-go/blob/main/parquet/pqarrow/column_readers.go"
click node_pq_props "https://github.com/apache/arrow-go/blob/main/parquet/writer_properties.go"
click node_flight "https://github.com/apache/arrow-go/blob/main/arrow/flight/client.go"
click node_flightsql_client "https://github.com/apache/arrow-go/blob/main/arrow/flight/flightsql/client.go"
click node_flightsql_server "https://github.com/apache/arrow-go/blob/main/arrow/flight/flightsql/server.go"
click node_variant "https://github.com/apache/arrow-go/blob/main/arrow/extensions/variant.go"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_types,node_arrays,node_memory,node_bitmaps,node_scalars,node_variant toneBlue
class node_compute_api,node_kernels toneAmber
class node_csv,node_ipc,node_cdata,node_avro,node_converter toneMint
class node_pq_schema,node_pq_pages,node_pq_stats,node_pq_arrow,node_pq_props toneRose
class node_flight,node_flightsql_client,node_flightsql_server,node_user toneIndigo
```

## Components

### Arrow Core

- [Arrow Types](https://github.com/apache/arrow-go/blob/main/arrow/datatype_fixedwidth.go): `arrow/datatype_fixedwidth.go`
- [Arrays & Batches](https://github.com/apache/arrow-go/blob/main/arrow/array/numericbuilder.gen.go): `arrow/array/numericbuilder.gen.go`
- [Memory Management](https://github.com/apache/arrow-go/blob/main/arrow/memory/allocator.go): `arrow/memory/allocator.go`
- [Bitmap Utilities](https://github.com/apache/arrow-go/blob/main/arrow/bitutil/bitmaps.go): `arrow/bitutil/bitmaps.go`
- [Scalar Values](https://github.com/apache/arrow-go/blob/main/arrow/scalar/scalar.go): `arrow/scalar/scalar.go`
- [Variant Extension](https://github.com/apache/arrow-go/blob/main/arrow/extensions/variant.go): `arrow/extensions/variant.go`

### Compute

- [Compute API](https://github.com/apache/arrow-go/blob/main/arrow/compute/arithmetic.go): `arrow/compute/arithmetic.go`
- [Compute Kernels](https://github.com/apache/arrow-go/blob/main/arrow/compute/internal/kernels/vector_selection.go): `arrow/compute/internal/kernels/vector_selection.go`

### Data Formats

- [CSV I/O](https://github.com/apache/arrow-go/blob/main/arrow/csv/reader.go): `arrow/csv/reader.go`
- [Arrow IPC](https://github.com/apache/arrow-go/blob/main/arrow/ipc/reader.go): `arrow/ipc/reader.go`
- [C Data Interface](https://github.com/apache/arrow-go/blob/main/arrow/cdata/cdata.go): `arrow/cdata/cdata.go`
- [Avro Reader](https://github.com/apache/arrow-go/blob/main/arrow/avro/reader.go): `arrow/avro/reader.go`
- [Avro Converter](https://github.com/apache/arrow-go/blob/main/arrow/avro/avro2parquet/main.go): `arrow/avro/avro2parquet/main.go`

### Parquet

- [Parquet Schema](https://github.com/apache/arrow-go/blob/main/parquet/schema/reflection.go): `parquet/schema/reflection.go`
- [Parquet Pages](https://github.com/apache/arrow-go/blob/main/parquet/file/page_reader.go): `parquet/file/page_reader.go`
- [Parquet Statistics](https://github.com/apache/arrow-go/blob/main/parquet/metadata/statistics.go): `parquet/metadata/statistics.go`
- [Arrow-Parquet Bridge](https://github.com/apache/arrow-go/blob/main/parquet/pqarrow/column_readers.go): `parquet/pqarrow/column_readers.go`
- [Writer Properties](https://github.com/apache/arrow-go/blob/main/parquet/writer_properties.go): `parquet/writer_properties.go`

### Flight Services

- [Flight RPC](https://github.com/apache/arrow-go/blob/main/arrow/flight/client.go): `arrow/flight/client.go`
- [FlightSQL Client](https://github.com/apache/arrow-go/blob/main/arrow/flight/flightsql/client.go): `arrow/flight/flightsql/client.go`
- [FlightSQL Server](https://github.com/apache/arrow-go/blob/main/arrow/flight/flightsql/server.go): `arrow/flight/flightsql/server.go`

### Other components

- **Go Application**

## Connections

- Go Application → Arrays & Batches: creates data (evidence: `README.md`)
- Arrays & Batches → Arrow Types: uses types (evidence: `arrow/array/numericbuilder.gen.go`)
- Arrays & Batches → Memory Management: allocates buffers (evidence: `arrow/array/numericbuilder.gen.go`)
- Arrays & Batches → Bitmap Utilities: uses bitmaps (evidence: `arrow/array/numericbuilder.gen.go`)
- Go Application → Compute API: invokes operations (evidence: `README.md`)
- Compute API → Compute Kernels: dispatches kernels (evidence: `arrow/compute/arithmetic.go`)
- Compute API → Scalar Values: uses values (evidence: `arrow/compute/arithmetic.go`)
- Go Application → CSV I/O: reads or writes (evidence: `README.md`)
- Go Application → Arrow IPC: streams batches (evidence: `README.md`)
- Arrow IPC → Memory Management: allocates buffers
- Go Application → C Data Interface: exchanges data (evidence: `README.md`)
- Avro Converter → Avro Reader: reads records (evidence: `arrow/avro/avro2parquet/main.go`)
- Avro Converter → Arrow-Parquet Bridge: writes batches (evidence: `arrow/avro/avro2parquet/main.go`)
- Arrow-Parquet Bridge → Writer Properties: configures writer
- Arrow-Parquet Bridge → Parquet Schema: maps schemas (evidence: `parquet/pqarrow/column_readers.go`)
- Arrow-Parquet Bridge → Parquet Pages: reads pages (evidence: `parquet/pqarrow/column_readers.go`)
- Parquet Pages → Parquet Statistics: reads statistics (evidence: `parquet/file/page_reader.go`)
- Go Application → Flight RPC: transfers batches (evidence: `README.md`)
- FlightSQL Client → Flight RPC: uses RPC client (evidence: `arrow/flight/flightsql/client.go`)
- FlightSQL Server → Flight RPC: routes RPC (evidence: `arrow/flight/flightsql/server.go`)
- Go Application → Variant Extension: uses extension (evidence: `arrow/extensions/variant.go`)
