Data Engineer

The role

You will work very closely with the Data team lead and the other team members who will be assisting you whenever needed, making your integration in the company as smooth as possible.

The Data team works in an organised way using Agile methodologies and tools such as Jira and regular standups. You will find an environment where you have a clear engineering direction, can focus on your work and hone your skills as a data engineer through exciting projects. You will always be able to count on the support of many engineers across the company.

What you will do

The team’s responsibilities currently span across three different areas

Data Engineering: development and maintenance of ETL pipelines, services and APIs, and data-related infrastructure like Redshift or BigQuery;
Data Science and Machine Learning: data exploration, ML models training and ML Ops to extract new insights from data;
Analytics and Reporting: creation of data models and dashboards as well as automation of reporting pipelines for different teams, stakeholders and third-parties.

In a typical week, a data engineer in the Data team would

Add a new python ETL pipeline that segments users interested in specific sports through analysing behaviour which streamlines and tailors marketing communications to those users;
Develop a new endpoint to a Flask API, add unit tests, and deploy the new version of the API into our production Kubernetes cluster;
Train and evaluate an ML model to identify certain user patterns and provide it as service to other engineering teams in a Flask API;

As a member of the data team, your responsibilities will include contributions to

Developing and maintaining our Data ETL pipelines, some of which are real-time. The pipelines are fundamental to helping teams and stakeholders understand and drive business direction. Data components can also be user facing e.g. sending notifications to users;
Ensuring our data lake is kept in a healthy state, particularly our data warehouses: Redshift and Bigquery;
Developing and maintaining Flask services and Postgres databases within the Data team to provide access to data or manage certain business entities relevant to Data.
Assisting the different teams in the company with reporting, especially when it comes to automated reporting pipelines.
Doing data exploration and training & deploying ML models used to perform different kinds of user segmentation, detect operational anomalies or estimate important business quantities. In particular maintain and improve our existing recommender service that provides users with suggestions on new sport competitions.

Data Engineer

The role

Data Engineer

The role

The team

What you will do

The team’s responsibilities currently span across three different areas

In a typical week, a data engineer in the Data team would

As a member of the data team, your responsibilities will include contributions to

What you need

Smarkets: predicting the future of betting

Team tech stack

Pay and benefits

These include

About Smarkets

Similar jobs at other companies

Senior Data Engineer

Data Engineer

Lead Data Engineer

Senior Data Engineer

Data Engineer

Senior Data Engineer

Smarkets