Software Engineer - Data Engineering
Akuna Capital, Chicago, IL +1
What you will do
- Work within a growing Data Engineering division supporting the strategic role of data at Akuna
- Drive the ongoing design and expansion of our data platform across a wide variety of data sources, supporting an array of streaming, operational and research workflows
- Work closely with Trading, Quant, Technology & Business Operations teams throughout the firm to identify how data is produced and consumed, helping to define and deliver high impact projects
- Build and deploy batch and streaming pipelines to collect and transform our rapidly growing Big Data set within our hybrid cloud architecture utilizing Kubernetes/EKS, Kafka/MSK and Databricks/Spark.
- Mentor junior engineers in software and data engineering best practices
- Produce clean, well-tested, and documented code with a clear design to support mission critical applications
- Build automated data validation test suites that ensure that data is processed and published in accordance with well-defined Service Level Agreements (SLA’s) pertaining to data quality, data availability and data correctness