Data Engineer responsible for ingestion pipelines and data quality on AI-driven marketing platform. Collaborating with data teams to ensure accuracy and performance of data systems.
Responsibilities
Reliability and completeness of our multi-provider ingestion pipeline: build failover logic, track daily completion rates per AI provider, and maintain the systems that ensure customers always get accurate, timely data
Data quality and consistency end to end: own the contracts between ingestion, processing, and downstream serving so that what customers see in the product is correct and trustworthy
Extraction pipeline performance: design and maintain async processing patterns that keep our ingestion throughput ahead of demand as we scale
Data readiness for new features: partner with engineering upstream so instrumentation, schema changes, and pipeline capacity are in place before features ship
Pipeline observability: build and maintain health monitoring across the full data stack so the team knows the state of the system in real time
Requirements
Built and maintained production data pipelines at meaningful scale, including experience with ingestion, ETL, and distributed job queue systems
Hands-on experience with ClickHouse or a comparable columnar store, including schema design, materialized views, and query optimization
Experience working with third-party data providers or scraping infrastructure at scale
Designed and owned reliability and observability systems: you have built the dashboards and alerting that tell you what is wrong before users do
Comfortable working close to the application layer: our stack is Rails and Postgres and this person will need to understand how backend systems feed the data platform
Benefits
Equity in a fast-growing startup
Competitive benefits package tailored to your location
Flexible time off policy
Parental Leave
A fun-loving and (just a bit) nerdy team that loves to move fast!
Senior Manager leading a team of database engineers to manage CCC's data platform. Overseeing mission - critical applications and collaborating with cross - functional teams in a hybrid environment.
As a Principal Data Architect at Solstice, lead the design and implementation of data architecture solutions. Ensure data integrity, security, and accessibility to meet strategic organizational goals.
Data Platform Specialist overseeing data workflows and enhancing data quality for Stackgini's AI - driven IT solutions. Collaborating with teams to drive improvements and stakeholder support.
Data Engineer designing data pipelines in Python for a major railway industry client. Collaborate with Data Scientists and ensure code quality with agile methodologies.
Senior Data Engineer responsible for building and optimizing data pipelines for banking analytics initiatives. Collaborating with data teams to ensure data quality and readiness for enterprise use.
Senior Data Engineer developing scalable data solutions on Databricks for analytics and operational workloads. Collaborating with cross - functional teams to modernize the data ecosystem.
Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.