Backend/Data Engineer
Sweetspot, New York, New York
The role
As a Backend Engineer at Sweetspot, you will join a team dedicated to pushing the boundaries of LLM usage over disparate and unstructured data sources across United States federal and state governments. You will play a critical role in building and integrating data pipelines that feed directly into a framework built for the aforementioned. More broadly, you will join a team that is highly focused on building a product that bolsters the American economy and provides every business, regardless of size, the tools they need to secure government opportunities.
Please note that this is role is only open to US citizens.
What you will do
- Design, develop, and maintain scalable and efficient data pipelines to process and transform large volumes of data from disparate sources across the internet
- Implement and optimize data pipelines using Python/SQLAlchemy and Dagster, ensuring high performance, reliability, and scalability
- Work with PostgreSQL databases, including design, optimization, and troubleshooting