Data Engineer – Data Infrastructure & eDiscovery-6387

Data Engineer – Data Infrastructure & eDiscovery

itD is seeking an experienced Data Engineer to build, enhance, and maintain high-complexity data pipelines, data warehousing infrastructure, and monitoring and alerting systems supporting its Legal and eDiscovery team. The ideal candidate will bring deep expertise in SQL, Python, ETL pipeline development, and workflow orchestration, with a proven track record of leading end-to-end data engineering initiatives across cross-functional teams. This individual will help deliver scalable, reliable, and secure data infrastructure while partnering with technical and non-technical stakeholders, including attorneys and Data Scientists.

Location: Remote – California. Candidates located in or near the San Francisco Bay Area are preferred. Candidates must indicate their willingness to occasionally work onsite in San Francisco.

Duration: 6 months

We provide comprehensive medical benefits, a 401(k) plan, paid holidays, and more.

Please note that we are only considering direct W2 candidates at this time, as we are unable to offer sponsorship.

Responsibilities

• Design, develop, and maintain complex ETL pipelines to support large-scale data extraction, transformation, and processing across enterprise data environments.
• Build and enhance scalable data warehousing solutions, ensuring efficient querying and management of massive datasets.
• Lead end-to-end development of high-complexity monitoring, alerting, and data pipeline systems to proactively identify and prevent infrastructure issues.
• Develop and optimize advanced SQL queries using technologies such as Presto, PostgreSQL, and MySQL.
• Collaborate with attorneys, Data Scientists, and cross-functional technical teams to understand data requirements, identify relevant data sources, and deliver reliable data solutions.
• Lead cross-functional engineering initiatives by defining project plans, coordinating stakeholders, preparing technical documentation, and driving successful implementation.
• Identify opportunities to leverage AI and automation to streamline workflows, improve operational efficiency, and support non-technical stakeholders while maintaining strong privacy and security standards.

Internal Responsibilities

• Attend regular internal practice community meetings.
• Collaborate with your itD practice team on industry thought leadership.
• Complete client case studies and learning material (blogs, media material).
• Build out material to contribute to the Digital Transformation practice.
• Attend internal itD networking events (in person and virtual).
• Work with leadership on career fast-track opportunities.

Required Qualifications and Skills

• 3+ years of professional experience in Data Engineering.
• Expert-level proficiency in SQL, including experience with relational databases such as Presto, PostgreSQL, or MySQL.
• Expert-level proficiency in Python.
• Expert-level experience building, managing, and optimizing ETL/data pipelines.
• Expert-level proficiency with workflow orchestration and data pipeline tools such as Apache Airflow or similar technologies.
• Demonstrated experience leading end-to-end data engineering initiatives involving large, cross-functional teams and diverse technical and non-technical stakeholders.
• Strong written and verbal communication skills, with the ability to communicate complex technical concepts clearly and concisely.
• Experience navigating ambiguous requirements and independently driving technical projects to completion.

Education

Bachelor’s degree in a relevant field or equivalent work experience required.

Company Description About itD: We are part of a new generation of consulting and software development company that blends diversity, innovation, and integrity with real business results. Our structure rejects any strong hierarchy, empowering us to deliver excellent results. We are a woman- and minority-led firm. Every day, we challenge ourselves to be considerate, fair and to re-think what great outcomes mean for our customers. This permeates down to how we approach every interaction, on every project, for every client.

You’ll thrive here if you are a dynamic self-starter, a difference-maker or someone who wants to deliver great results, without constraints.

The itD Digital Experience: Joining us means you’ll be part of our global community, you have a say about your own career journey, and you’ll get a chance to give back to causes that matter. You will experience working with Fortune 500 companies and high-performance teams across numerous industries. itD offers our employees excellent benefits such as medical, dental, vision, life insurance, paid holidays, 401K + matching, networking & career learning and development programs. We are growing and we want to see you grow! Visit https://itdtech.com/careers to learn more about what working at itD can mean for you.

Additional Info Dynamic environment in a culture of respect, empowerment and recognition for a job well done, apply today!

• Demonstrated experience leveraging AI to accelerate project delivery or developing AI-powered solutions to automate workflows for non-technical stakeholders.
• Experience working in highly regulated industries, including legal, compliance, finance, security, or privacy.
• Previous experience supporting legal technology, eDiscovery, data privacy, or compliance-related initiatives.
• Experience with data loss prevention and remediation.
• Experience mentoring and supporting junior engineering team members.
• Previous experience working in startups, small-to-mid-sized organizations, or environments requiring adaptability and broad ownership.
• Experience working with attorneys, legal teams, or law firms through professional, internship, or volunteer experience.