How headcrab/mssql2file works
Main Components
a. Core Components:
• Input Layer (Database Connections)
• MSSQL
• MySQL
• ClickHouse
• Processing Layer
• Query Execution
• Data Processing
• Time Period Management
• Export Layer
• Format Processors
• Compression Handlers
• File Writers
b. Supporting Components:
• Configuration Management
• Error Handling
• Command Line Interface
Component Relationships
Database Sources → Data Processing → Export Processing → File Destinations
Detailed Component Breakdown
A. Input Section:
• Database Connectors (from internal/app)
• Configuration Management (from internal/config)
• Time Period Calculator
B. Processing Section:
• Query Executor
• Data Transformer
• Error Handler (from internal/apperrors)
C. Export Section:
Format Processors (from internal/format):
• JSON Processor
• CSV Processor
• XML Processor
Compression Handlers (from internal/compressor):
• GZip
• LZ4
• None (raw)
File Writers (from internal/file):
• Local File System
• FTP
• SMB
Implementation Details
• The modular architecture (visible in the internal/ directory structure)
• The plugin-style format and compression handlers
• The flexible file output system
• Configuration management
• Error handling pathways
Core Flow Layer
Database → Query Execution → Format Processing → Compression → File Output
Component Layer
Internal packages and their relationships:
• app: Main application logic
• config: Configuration management
• format: Data format processors
• compressor: Compression handlers
• file: File system interfaces
• apperrors: Error handling
Interface Layer
Interfaces between components:
• Database interfaces
• Format interfaces
• Compression interfaces
• File system interfaces