Market Data Pipeline

The Market Data Pipeline is responsible for the ingestion, validation, and standardization of market data using the new PyArrow-based architecture.

What you’ll find here:

• Market Data Processing Service – Core service for orchestrating the loading and metric extraction pipeline.

• Field Definitions and Constants – Standardized field names, enums, and constants used across the engine.