- 5+ years of data engineering experience
- Deep expertise with Apache Spark, including the PySpark DataFrame API and experience solving challenging scaling problems
- Experience with large-scale data processing, cluster configuration, optimization, and tuning (we use GCP Dataproc)
- Strong software development skills in Python (unit testing, git, code review, CI/CD)
- Experience with data storage formats (we use Parquet, Delta Lake)
- Experience with event streaming data (we use Kafka)
- Experience with cloud computing platforms (we use Google Cloud Platform)
- Experience with advanced query optimization
- Familiar with Software Development Lifecycle practices, such as continuous integration/continuous delivery and automated deployment (we use Docker, Kubernetes, and GitHub Actions)
- Ability to collaborate with technical partners - you'll be working closely with ML engineers, scientists, and other teams to determine requirements and make design decisions
- Enjoys working in a fast-paced, goal-driven environment
The base pay range for this position is $144K CAD - 188K CAD/year, which can include additional bonus depending on the position ultimately offered, in addition to a full range of medical, financial, and/or other benefits. The base pay offered may vary depending on job-related knowledge, skills, and experience.
Studies have shown that women, communities of color, and historically underrepresented people are less likely to apply to jobs unless they meet every single qualification. We are committed to building a diverse and inclusive culture where all Inkers can thrive. If you’re excited about the role but don’t meet all of the abovementioned qualifications, we encourage you to apply. Our differences bring a breadth of knowledge and perspectives that makes us collectively stronger.