Jobs Ask AI Pay Companies CompareSign in

Wait…

We read every job from the company's own job board. You apply on the company site.Jobs Job types Internships New graduate jobs Companies Pay Reported pay Check an offer Add your pay Compare with LinkedIn Job sites compared Pay transparency laws API for developers Monthly report Companies we cover Make a portfolio page For companies: find people About Privacy

Software Engineer (Big Data) - Recommendation Ecosystem Infrastructure

ByteDance, Singapore

Posted pay

Pay not posted

Location: Singapore
Work type: Not given
Level: Not given
Experience: 5+ years
Skills in the job text: Python
Kubernetes
Java
C++
Spark
Flink
Scala
Posted: Not given
Last check: 9 h ago
Job type: Infra, platform & SRE

Apply on the ByteDance site Sign in to save

The ByteDance site opens in a new tab.

B

ByteDance

About ByteDance: funding, hiring and pay

Check my fit

Compare your résumé with this job. See where you match, what is missing and which lines to change.

Sign in to check your fit

What you will do

Design and implement real-time (streaming computing) data systems for large-scale recommendation systems.
Create flexible, scalable, stable, and high-performance storage systems and computing models.
Troubleshoot production system failures, design and implement necessary mechanisms and tools to ensure overall stability of the production systems

Construct industry-leading streaming computing frameworks and other distributed systems to provide reliable infrastructure for massive data and large-scale business systems

Research, design, and develop computer and network software or specialised utility programs.

Analyse user needs and develop software solutions, applying principles and techniques of computer science, engineering, and mathematical analysis.

Update software, enhances existing software capabilities, and develops and direct software testing and validation procedures.

Work with computer hardware engineers to integrate hardware and software systems and develop specifications and performance requirements.

What you need

Proficient in programming languages like Java, C++, Scala, Python.
Strong coding and troubleshooting skills.
At least 5 years of relevant experience
Deep understanding of streaming computing systems, with formal production experience in developing TB-level Flink real-time computing systems. Proficient in modules like FlinkDataStream, FlinkSQL, FlinkCheckpoint, FlinkState, and preferably with experience in reading Flink source code.
Familiar with at least one data lake technology such as Hudi, Iceberg, DeltaLake, and preferably with experience in reading their source code.
Willingness to tackle problems without clear answers, with a strong passion for learning new technologies.

Nice to have

Experience in handling PB-level data is a plus.
Familiarity with other big data systems is preferred, including YARN, K8S, Spark, SparkSQL, Kudu, and others.
Experience in storage systems such as Hbase, Cassandra, RocksDB.
Experience in data lake development is preferred.

About ByteDance

The Data Ecosystem Team has the vital role of crafting and implementing a storage solution for offline data in our recommendation system, which caters to more than a billion users. Their primary objectives are to guarantee system reliability, uninterrupted service, and seamless performance. They aim to create a storage and computing infrastructure that can adapt to various data sources within the recommendation system, accommodating diverse storage needs. Their ultimate goal is to deliver efficient, affordable data storage with easy-to-use data management tools for the recommendation, search, and advertising functions.

Read the job posting on the ByteDance site

Similar jobs at other companies

Software Engineer (Big Data) - Application Computing
TikTokSingapore
- Software engineering
- 2 positions
Pay not posted
Backend Engineer - Application Computing (Data + AI)
TikTokSingapore
- Software engineering
Pay not posted
Senior/Staff Big Data Storage and Computing Engineer, Recommendation Data Ecosystem
TikTokSan Jose, California
- Staff
- Infra, platform & SRE
- 2 positions
Pay not posted
Software Engineer, Recommendation Infrastructure
TikTokSan Jose, California
- Infra, platform & SRE
- 2 positions
Pay not posted
Backend Software Engineer, TikTok Data Ecosystem (Data Lake)
TikTokSingapore
- Software engineering
- 2 positions
Pay not posted
Big Data Engineer, TikTok Recommendation Architecture
TikTokSingapore
- Data engineering
- 2 positions
Pay not posted

Source: the company job board. We last checked this job 9 h ago. We first saw it 3 days ago. A job on a job board does not always mean that the team interviews people now.

Company facts

Money raised: $4BSum of funding rounds on record
Newest round: Funding roundOct 26, 2018

Funding records can have errors and can be missing. The company page has the links.

ByteDance

Open tech jobs: 706
With posted pay: 2%
Median posted base: $187K–$317K

About ByteDance: funding, hiring and pay