Data Engineer - Commodities

The Commodities Technology team builds and operates a data platform that aggregates and curates critical commodities data, including weather, supply and demand, storage, transportation, and other fundamental and alternative datasets. The team’s curated content layer supports Portfolio Managers and researchers in understanding markets and constructing trades. As part of Millennium’s Information Technology organization, the team develops flexible, scalable technology and proprietary systems that support advanced analytical and trading capabilities.

• Design, implement, and maintain end-to-end ETL workflows in Python and SQL to ingest and transform commodities data from multiple vendor and internal sources.
• Build and maintain standardized data models, schemas, and metadata that make commodities datasets easy to understand, discover, and reuse.
• Schedule, monitor, and manage data pipelines using Airflow or similar workflow orchestration tools to ensure reliable, timely data delivery.