How apache/opendal works
Main Components of the System
┌─────────────────────────────────────────────────────────┐
• Client Applications │
• ┘
• ↓
┌─────────────────────────────────────────────────────────┐
• Language Bindings │
• Rust │ Java │ Python │ Node.js │ Go │ C/C++ │ Others │
• ┘
• ↓
┌─────────────────────────────────────────────────────────┐
• OpenDAL Core │
• ┌─────────────┐ ┌──────────┐ ┌──────────────┐ │
• Services │ │ Layers │ │ Types │ │
• ┘ └──────────┘ └──────────────┘ │
• ┘
• ↓
┌─────────────────────────────────────────────────────────┐
• Storage Services │
• ┘
Component Details
a. Storage Services Layer (Bottom):
• Services by type:
• Standard Protocols (FTP, HTTP, SFTP, WebDAV)
• Object Storage (S3, Azure Blob, GCS, etc.)
• File Storage (FS, HDFS, etc.)
• Key-Value Storage (Redis, etcd, etc.)
• Database Storage (MongoDB, MySQL, etc.)
• Cache Storage (Memcached, etc.)
b. OpenDAL Core (Middle):
• Services: Implementation of storage service adapters
• Layers: Cross-cutting concerns (retry, logging, metrics)
• Types: Core data structures and traits
c. Language Bindings (Upper Middle):
• Supported language bindings
• Stability status (released vs. in development)
d. Client Applications (Top):
• CLI Tools (oli, oay, ofs)
• Integration Points (FUSE, WebDAV, etc.)
Connection and Data Flow
• Data flow direction between layers
• API calls and responses
• Integration points
• Cross-cutting concerns
Additional Details
Annotations for:
• Supported operations (read, write, list, delete)
• Capability indicators
• Version compatibility
• Performance characteristics