Job Summary
DataPelago is at the forefront of revolutionizing data processing for traditional analytics and cutting-edge GenAI preprocessing. We are building an innovative data processing engine that is transforming how Apache Spark, Apache Flink, Ray and others operate on diverse, large-scale data. Our team of engineers drive and adopt advances in hardware-accelerated computing, parallel processing of large-scale data, query optimization, distributed systems, compilers, machine learning, and cloud-native computing. We are looking for specialists to join our engineering team and shape the future of accelerated data processing.
DataPelago Nucleus is a universal data processing engine that is designed to accelerate the processing of diverse data – structured through unstructured – with any parallel processing framework – e.g., Apache Spark – on any infrastructure – including vectorized CPU and GPU. DataPelago Accelerator for Spark (DPA-S), our product based on DataPelago Nucleus, is running large-scale production applications of many globally renowned customers.
As a Senior/Principal Data Processing Optimization Engineer, you will be a key individual contributor in advancing planner and optimization capabilities so that DataPelago acceleration delivers the most performance and cost reduction for open-source software SQL and Python processing engines running on CPU-based and GPU-based infrastructure. This is a unique opportunity to make a significant impact on a category-defining product and work with a talented team of engineers.
The target salary range for this position is 227,800 - 338,800 USD. The salary offered will be determined by the candidate's location, qualifications, experience, and education and may be outside of this range. Final compensation packages are competitive and in line with industry standards, reflecting a variety of factors, and include a comprehensive benefits package. This may cover Health Insurance, Life Insurance, Retirement or Pension Plans, Paid Time Off, various Leave options, Performance-Based Incentives, employee stock purchase plan, and/or restricted stocks (RSU’s), with all offerings subject to regional variations and governed by local laws, regulations, and company policies.
Benefits may vary by country and region, and further details will be provided as part of the recruitment process.
Pay not posted
Posted Jul 27, 2026
Pay not posted
Posted Jun 15, 2026
Woven by ToyotaPalo Alto, CA +1
$189K–$311K / yr
Posted 19 days ago
Pay not posted
Posted Dec 10, 2024
Source: the company job board. We last checked this job 33 min ago. We first saw it 33 min ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.
Pay not posted
Posted Oct 9, 2026
Pay not posted
Posted Oct 6, 2026
No one has reported an interview at NetApp yet. Did you interview there? Add the questions.
See total pay at NetApp on Levels.fyiBase, stock and bonus, as employees report it.
This base pay is near the median for principal software engineering jobs in the Bay Area.
We compare the middle of each posted range. This is base pay as posted. The group does not include this job.