Data Engineer
ScaleOps, Tel Aviv +1
What you will do
We're looking for a Data Engineer to build the data foundation behind ScaleOps' internal AI initiatives and analytics. You'll own pipelines and models spanning infrastructure telemetry and customer conversations, making data from across the business reliable and accessible to AI agents, dashboards, and teams in R&D, Sales, Support, and Customer Success.
- Data Pipelines: Design, build, and operate batch and streaming pipelines that ingest Kubernetes telemetry and data from sources such as Prometheus, Grafana, Salesforce, Gong, and Slack.
- Analytical Data Platform: Own and evolve our ClickHouse data lake, including schema design, partitioning, query performance, coverage, and cost efficiency.
- Data Modeling: Build data models and semantic layers that AI agents and analysts can query reliably.
- Data for AI Applications: Support RAG pipelines, including chunking, embeddings, indexing in vector databases, time series data, and monitoring for freshness and quality.
- Data Reliability: Establish data quality checks, lineage, and observability. Investigate issues and fix their root causes when data breaks.