Senior Data Engineer on CNN's AI Enablement & Machine Learning team optimizing ML and AI experiences. Collaborating with engineers to enhance data pipelines and integrate features into platforms.
About the role
- Senior Data Engineer driving sustainability through cost and climate intelligence at Spotify. Building scalable data infrastructure and optimizing cost practices for Spotify’s growth.
Responsibilities
- Be responsible for the design, implementation, and evolution of scalable, reliable data infrastructure that underpins Spotify’s cost and carbon intelligence.
- Own end-to-end data pipelines for cloud cost, usage, and emissions data: spanning ingestion, transformation, modeling, and serving layers.
- Partner deeply with Data Scientists, Engineering, Finance, and Procurement to translate sophisticated analytical and business needs into robust data architectures.
- Set technical direction and standards for data modeling, orchestration, testing, and observability within the Cost Engineering domain.
- Build and maintain curated, analytics-ready datasets that power executive reporting, forecasting, and optimization initiatives.
- Ensure data accuracy, consistency, and timeliness for high-stakes cost and emissions reporting used to guide strategic infrastructure investments.
- Proactively identify opportunities to improve the scalability, reliability, and cost efficiency of the data platform itself.
- Mentor other engineers and act as a technical sounding board, raising the overall bar for data engineering perfection on the team.
- Work across all Missions at Spotify to embed cost and climate awareness into decision-making, with a focus on accurate attribution of spend and carbon impact.
Requirements
- A senior data engineer with a strong track record of owning and operating production-critical data systems end to end.
- Hold a degree in computer science, engineering, or a related technical field, or equivalent proven experience.
- Experienced in designing data architectures that scale with both data volume and organizational complexity.
- Comfortable leading technical discussions, influencing build decisions, and aligning partners around long-term solutions.
- Thrive in environments with evolving requirements, balancing speed of delivery with adaptability and correctness.
- Strong communicator who can explain sophisticated technical concepts clearly to both technical and non-technical audiences.
- Familiar with financial, billing, or usage data, and able to connect infrastructure metrics to real business and sustainability impact.
- Hands-on experience with cloud data platforms (GCP preferred).
- Highly proficient with Python, SQL, DBT, and modern orchestration frameworks and experienced with data quality and observability tooling.
- Experience with at least one data processing framework such as Spark, Flink, or Dataflow
Benefits
- health insurance
- six month paid parental leave
- 401(k) retirement plan
- monthly meal allowance
- 23 paid days off
- 13 paid flexible holidays
- paid sick leave
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Engineer at Sand Cherry Associates with expertise in ETL, Python, and SQL. Responsible for designing data structures and maintaining accuracy for client projects.
Data Engineer responsible for creating and maintaining ETL pipelines at Sand Cherry Associates. Requires strong expertise in Redshift SQL, Python, and DBT with hybrid work structure.
Data Engineer responsible for creating and maintaining ETL pipelines at Sand Cherry Associates with expertise in Redshift SQL, Python, and DBT.
Data Engineer responsible for the end - to - end data infrastructure at AVK. Designing ETL pipelines and collaborating with teams on data solutions.
Migration Engineer leading data migrations to GiG’s CoreX platform with a focus on data integrity and collaboration.
Data Platforms Manager overseeing technical delivery of engineering initiatives for Disney's data solutions. Leading project teams, innovation, and multi - stakeholder collaborations in a fast - paced environment.
Senior Data Engineer with expert - level database skills at FreedomPay. Collaborating on data pipelines and products across SQL Server and Snowflake.
Migration Engineer for GiG’s Migrations Team managing and executing data migrations and ensuring data integrity. Collaborating with various stakeholders on the CoreX platform migrations.
Migration Engineer responsible for migrating brands to CoreX platform at GiG. Collaborating on data pipelines and integrity with cross - functional teams.