Data Engineer transforming data for analysis in an insurance company. Responsible for building data infrastructures and optimizing data delivery.
TC
Hybrid Senior Data Engineer – Audience Manager Platform
Posted 4 months ago
About the role
- Senior Data Engineer building and maintaining Audience Manager Platform for Disney's media and advertising digital solutions. Collaborating with engineering teams on audience data initiatives.
Responsibilities
- Build and maintain audience platform initiatives to improve and expand audience targeting capabilities.
- Partner with technical and non-technical colleagues to understand audience data and targeting requirements.
- Work with engineering teams to collect required data from internal and external systems.
- Support Agile methodologies such as Scrum by actively participating in regular ceremonies such as stand-up, retrospectives and sprint planning.
- Design table structures and define ETL pipelines to build performant and scalable solutions
- Develop Data Quality checks
- Participate in on-call support
- Develop and maintain ETL routines using ETL and orchestration tools such as Airflow
- Perform ad hoc analysis and SQL and ETL tuning as necessary.
- Participate in code reviews and problem-solving.
Requirements
- 5+ years of big data engineering experience modeling and developing large data pipelines
- Hands-on experience with distributed systems such as Spark, Hadoop (HDFS, Hive, Presto, PySpark)
- Strong Python and SQL skills processing big datasets
- Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query, Databricks)
- Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices
- API and backend development experience
- Bachelor’s degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience.
Benefits
- Health insurance
- 401(k) matching
- Flexible work hours
- Paid time off
- Bonuses and/or long-term incentive units dependent on position
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Senior Data Engineer for the MDM Data Product Team at Avenga. Responsible for provisioning data from master data customer and product systems.
Data Warehouse Modelling Engineer designing and maintaining data models using Data Vault 2.0 for iGaming industry. Collaborating with stakeholders and optimizing data models in a hybrid work environment.
Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.
Data Engineer Manager at PwC focusing on building data infrastructure and solutions. Leading data engineering projects to transform raw data into actionable insights and drive business growth.
Junior Data Engineer at OneMarketData focusing on data quality and integrity in financial datasets. Collaborating with senior analysts and assisting in data management and analysis tasks.
Data Engineer Manager leading robust data solutions for PwC's clients. Transforming raw data into actionable insights and coaching team members.
Senior Data Engineering Analyst developing and implementing data solutions. Collaborating in a diverse environment focused on data processing and analysis for clients' digital transformation.