Lead Data Engineer - Data Archival - Bangalore
Photon, India
What you need
- Experience: 3-5 Years
- Skills:
- Computer programming: Spark, Scala, Java, Python
- Operating system knowledge for Unix, Linux
- Databases and SQL
- ETL and data warehousing
- Hadoop
- Apach Spark
Tasks
- Maintain an excellent service level of the platform and avoid issues.
- Researching new methods of obtaining valuable data and improving its quality
- Creating and enhancing data solutions using various programming languages and tools
- Creating and enhancing data architectures that meet the requirements of the business
- Communicate inside if the tech league group to find new approaches
Missions
- Job description:
Our team Data-as-a-service is expanding, and we need 3 big data experts to join us!
Today we manage SG Data platform service offers and data tools
- Data ingestion: to ingest the data from a data source
- Data processing: to process, transform and distribute the data to the target location
- Data exposition : to distribute and expose the data hosted in the data platform
- Data cleaning: to purge the data on the Lake in a secure way
- Data tools: data formatter, data anonymizer
As a big data engineer, you’ll develop, maintain and create new cloud-oriented features hand-by-hand with DDS/Data Foundation teams to bring forward the data approach across all SG entities and subsidiaries.
Similar jobs at other companies
Senior Data Engineer - R01569573
BrillioBangalore, Karnataka, India
Pay not posted