How jainfamilyinstitute/azure-connectors works
Main Components
a) Core Components:
• Credential Management System
• Client Factory
• Service Connectors (SQL, Blob, DataLake, Tables)
• Configuration Management
• DataFrame I/O Handlers
• Validation Layer
b) External Components:
• Azure Services (SQL, Blob Storage, Data Lake, Tables)
• Azure Authentication (CLI and Default credentials)
• Client Applications (showing integration points)
Specific Design Elements
Use these visual elements:
• Rectangles: Core library components
• Hexagons: External authentication sources
• Double lines: API boundaries
Detailed Component Breakdown
a) Credential Management:
credential/
• credential.py
• settings.py
As central authentication hub
b) Service Connectors:
azure_blob/
azure_datalake/
azure_sql/
azure_tables/
As separate modules with their respective SDK clients
c) Configuration:
config/
• env_file.py
• settings_config.py
As a supporting layer feeding into all components
Authentication Flow
• Environment Variables → Credential Management → Azure Services
Client Creation Flow
• Client Factory → Service Connectors → Azure SDK Clients
Data Flow
• DataFrame I/O → Service Connectors → Azure Services
Important Notes
• Passwordless nature of authentication
• Both local (CLI) and deployed (default) authentication paths
• Environment variable configuration points
• Two main entry points mentioned in the README:
• AzureSqlConnection
• SDK Client shadow constructors