How ibis-project/ibis works
Ibis is a portable Python dataframe library: users build lazy expressions, select a backend, and execute against a local or remote engine to obtain dataframe results. SQL backends compile expressions to backend-native SQL; DataFrame backends use their native execution model. The graph preserves major documented capabilities, including Python/SQL composition, interactive exploration, and user-defined functions. Several backend internals are unsampled, so only documented relationships are shown; the format adapters represent conversion support, not a claimed execution sequence.
Main entry points: schema.py Schemas · __init__.py Backend interface · backends SQL backends · api.py Public API
Components 21
Expression API
- Public API
ibis/expr/api.py - Relational expressions
ibis/expr/types/relations.py - Expression operations
ibis/expr/operations
Execution backends
- SQL compilers
ibis/backends/sql/compilers - Backend interface
ibis/backends/__init__.py - Backend loading
ibis/__init__.py - SQL backends
ibis/backends - DataFrame backends
ibis/backends
Types and formats
- Data types
ibis/expr/datatypes/core.py - Schemas
ibis/expr/schema.py - Pandas adapter
ibis/formats/pandas.py - Polars adapter
ibis/formats/polars.py - PyArrow adapter
ibis/formats/pyarrow.py
Shared capabilities
- Configuration
ibis/config.py - User-defined functions
ibis/expr/operations/udf.py - Interactive mode
ibis/interactive.py - Expression utilities
ibis/common
Other components
- Python user
- Database or engine
- DataFrame engine
- Dataframe result
Connections 21
- Python user → Public API: builds expressions
- Public API → Relational expressions: creates expressions
ibis/expr/api.py - Relational expressions → Expression operations: represents operations
ibis/expr/types/relations.py - Python user → Backend loading: selects backend
- Backend loading → Backend interface: loads backend
ibis/__init__.py - Backend interface → SQL backends: provides interface
ibis/backends/__init__.py - Backend interface → DataFrame backends: provides interface
ibis/backends/duckdb/__init__.py - SQL backends → SQL compilers: compiles to SQL
ibis/backends/materialize/__init__.py - SQL backends → Database or engine: executes queries
- SQL compilers → Database or engine: targets native SQL
- DataFrame backends → DataFrame engine: uses native model
- DataFrame engine → Dataframe result: returns dataframe
- Database or engine → Dataframe result: returns results
- Schemas → Data types: describes columns
ibis/expr/schema.py - Pandas adapter → Schemas: maps schema
ibis/formats/pandas.py - Polars adapter → Schemas: maps schema
ibis/formats/polars.py - PyArrow adapter → Schemas: maps schema
ibis/formats/pyarrow.py - Python user → User-defined functions: defines functions
- Python user → Interactive mode: explores results
- Python user → Configuration: sets options
- Expression operations → Expression utilities: uses utilities
ibis/common/patterns.py