Data Engineer - Infrastructure
IMC, Chicago
The role
We are hiring an Engineer to join our Data Engineering Infrastructure team, where you will help build and scale the storage and data platforms that power our HFT business. This is a hands-on role for someone who enjoys working close to the bare metal systems. Operating large-scale open-source storage, enterprise storage, tuning Linux systems for performance, automating infrastructure. As our data footprint grows, you will play a key part in keeping our infrastructure fast, reliable, and ready to scale.
What you will do
- Design, deploy, and operate large-scale data storage infrastructure, including Hadoop, enterprise storage and S3-compatible platforms
- Tune Linux systems for I/O throughput and overall performance
- Automate configuration and deployment using Ansible, Puppet or other automation platform
- Build observability into the platform with Prometheus and related tooling
- Partner with engineering teams to deliver reliable, well-architected data solutions with a focus on Storage and Kafka