How astrolabsoftware/spark3d works
spark3D extends Spark SQL/RDD processing for three-dimensional datasets, exposing Scala and Python APIs. The main workflow accepts spatial data, represents it with 3D shapes, partitions or repartitions it, then supports spatial queries and visualization. The graph preserves both API surfaces and the documented visualization capability. Edges follow SOURCE INDEX references or the README; unsampled implementation details limit finer-grained links, especially for visualization internals.
Main entry points: __init__.py Python API · Queries.scala Spatial Query API · Partitioners.scala Partition Selection · Shape3D.scala Shape Operations
Components 25
User APIs
- Scala API
src/main/scala/com/spark3d/package.scala - Python API
pyspark3d/__init__.py - Python Configuration
pyspark3d/pyspark3d_conf.py - Package Version
pyspark3d/version.py - Data Conversion
pyspark3d/converters.py
Spatial Model
- Python Geometry
pyspark3d/geometryObjects.py - 3D Points
src/main/scala/com/spark3d/geometryObjects/Point3D.scala - Shape Operations
src/main/scala/com/spark3d/geometryObjects/Shape3D.scala - Box Envelopes
src/main/scala/com/spark3d/geometryObjects/BoxEnvelope.scala - Shell Envelopes
src/main/scala/com/spark3d/geometryObjects/ShellEnvelope.scala - Coordinate Utilities
src/main/scala/com/spark3d/utils/Utils.scala
Partitioning
- Data Repartitioning
src/main/scala/com/spark3d/Repartitioning.scala - Partition Selection
src/main/scala/com/spark3d/Partitioners.scala - Partitioner Base
src/main/scala/com/spark3d/spatialPartitioning/SpatialPartitioner.scala - Octree Grid
src/main/scala/com/spark3d/spatialPartitioning/Octree.scala - Octree Partitioner
src/main/scala/com/spark3d/spatialPartitioning/OctreePartitioner.scala - Onion Partitioner
src/main/scala/com/spark3d/spatialPartitioning/OnionPartitioner.scala - Onion Grid
src/main/scala/com/spark3d/spatialPartitioning/OnionPartitioning.scala - Key Partitioner
src/main/scala/com/spark3d/spatialPartitioning/KeyPartitioner.scala
Queries And Display
- Spatial Query API
src/main/scala/com/spark3d/Queries.scala - Window Query
src/main/scala/com/spark3d/spatialOperator/WindowQuery.scala - Nearest Neighbors
src/main/scala/com/spark3d/spatialOperator/KNN.scala - Data Visualization
pyspark3d/visualisation.py
Other components
- Spark User
- Apache Spark
Connections 29
- Spark User → Scala API: uses Scala API
README.md - Spark User → Python API: uses Python API
README.md - Scala API → Data Repartitioning: exposes repartitioning
src/main/scala/com/spark3d/package.scala - Python API → Python Configuration: loads configuration
pyspark3d/__init__.py - Python Configuration → Package Version: reads version
pyspark3d/pyspark3d_conf.py - Python API → Data Conversion: uses converters
pyspark3d/converters.py - Python API → Python Geometry: exposes geometry
pyspark3d/geometryObjects.py - Python API → Apache Spark: bridges through Py4J
README.md - Scala API → Apache Spark: extends Spark
README.md - 3D Points → Shape Operations: implements shape
src/main/scala/com/spark3d/geometryObjects/Point3D.scala - Shape Operations → Box Envelopes: uses envelopes
src/main/scala/com/spark3d/geometryObjects/Shape3D.scala - Shape Operations → Coordinate Utilities: uses conversions
src/main/scala/com/spark3d/geometryObjects/Shape3D.scala - Box Envelopes → 3D Points: uses points
src/main/scala/com/spark3d/geometryObjects/BoxEnvelope.scala - Shell Envelopes → 3D Points: uses points
src/main/scala/com/spark3d/geometryObjects/ShellEnvelope.scala - Data Repartitioning → Partition Selection: selects partitioner
src/main/scala/com/spark3d/Repartitioning.scala - Data Repartitioning → Key Partitioner: uses key partitioner
src/main/scala/com/spark3d/Repartitioning.scala - Partition Selection → Partitioner Base: uses partitioner base
src/main/scala/com/spark3d/Partitioners.scala - Partition Selection → Octree Partitioner: selects octree
src/main/scala/com/spark3d/Partitioners.scala - Partition Selection → Onion Partitioner: selects onion
src/main/scala/com/spark3d/Partitioners.scala - Octree Partitioner → Octree Grid: uses grid
src/main/scala/com/spark3d/spatialPartitioning/OctreePartitioner.scala - Onion Partitioner → Onion Grid: uses grid
src/main/scala/com/spark3d/spatialPartitioning/OnionPartitioner.scala - Octree Grid → Box Envelopes: indexes envelopes
src/main/scala/com/spark3d/spatialPartitioning/Octree.scala - Onion Grid → Shell Envelopes: uses shells
src/main/scala/com/spark3d/spatialPartitioning/OnionPartitioning.scala - Spatial Query API → Window Query: delegates window query
src/main/scala/com/spark3d/Queries.scala - Window Query → Shape Operations: tests intersections
src/main/scala/com/spark3d/spatialOperator/WindowQuery.scala - Spatial Query API → 3D Points: uses points
src/main/scala/com/spark3d/Queries.scala - Spatial Query API → Shell Envelopes: uses shells
src/main/scala/com/spark3d/Queries.scala - Spatial Query API → Box Envelopes: uses boxes
src/main/scala/com/spark3d/Queries.scala - Spark User → Data Visualization: visualizes datasets
README.md