Senior Engineer, Competitive Benchmarking & Performance
Elastic, Canada
What you will do
- Own prioritized competitive benchmarking initiatives across search, vector and hybrid retrieval, and analytical and observability workloads.
- Build and maintain automated benchmark harnesses, datasets, query sets, and load profiles that reflect real-world usage, including concurrent ingestion and querying.
- Design fair comparisons with documented system versions, configurations, tuning decisions, resource budgets, and functional differences.
- Evaluate latency distributions, throughput, resource consumption, and cost efficiency. For retrieval workloads, measure performance at comparable recall or relevance targets.
- Adapt and extend workload-appropriate tools such as Elasticsearch Rally, ClickBench, and vector search benchmark frameworks.