Software Engineer at Warner Music Group developing an innovative Data Platform for the music industry. Collaborating with dynamic teams to enhance music data processing and delivery.
About the role
- Senior Data Engineer designing and building data warehouse solutions with Snowflake for a fintech company. Collaborating with cross-functional teams to facilitate data insights and analytics.
Responsibilities
- Design and build a data warehouse using computing–based data cloud (Snowflake) for machine learning, data analysis, self-serve analytics and reporting needs
- Develop Extract, Transform, Load (ETL) pipelines to orchestrate execution of scripts, automate data transformation and loading data into data warehouses
- Perform data cleansing, validation, testing and schema design to ensure accuracy and reliability of data insights
- Manage and build automated workflows and monitor these pipelines and DAGs (Directed Acyclic Graphs)
- Identify and work on improvements by automating manual processes to optimize data delivery, re-design infrastructure for more scalability using python & sql
- Collaborate with cross-functional teams including data engineers, analysts and data scientists to understand the business logic and needs to create an effective and efficient pipeline and data model
- Create ad-hoc report/data visualizations based on user requirements
- Participate in ETL flow design reviews and recommend solutions to improve processes
- Perform data quality checks and alerting to identify issues and resolve bugs in a timely manner
- Participate in source code and design reviews in a software development lifecycle (SDLC) driven environment using technical, functional, and domain knowledge
- Identify issues or gaps and suggest improvements to the team processes
- Provide support for customer requests for all the products handled by the team.
Requirements
- Master’s degree (or its foreign degree equivalent) in Analytics, Data Science, Engineering (any field), or a related quantitative discipline
- Six (6) months of experience in the job offered or in any occupation in related field
- Data warehouse design and dimensional modeling
- Extract, Transform, Load (ETL)
- SQL
- Python
- Data Visualization (Tableau or Power BI)
- Gitlab
- Azure
- PySpark
- OLAP and OLTP system experience (MySQL Database, Postgres DB, or Snowflake)
- Machine Learning
- Data Pipeline - Performance & Scalability Techniques.
Benefits
- Competitive salary
- Flexible work arrangements
- Professional development opportunities
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Engineer role specializing in Azure & Snowflake at InfoCentric. Leading design and delivery of enterprise - scale data platforms for large organizations.
Principal Data Architect at PointClickCare ensuring coherent and scalable data architecture. Driving unified data direction while collaborating with Engineering Architecture team for AI enablement.
Data Engineer Tech Lead developing data solutions at Carelon. Leading a cross - functional team to optimize data workflows and maintain data integrity.
Lead Data Engineer responsible for evolving Manna’s data infrastructure for drone delivery. Overseeing data architecture and analytics while building scalable data pipelines.
Data Engineer designing, implementing, and optimizing data pipelines for DeepLight AI. Collaborating closely with a multidisciplinary team to analyze large - scale data.
Data Engineer designing and maintaining scalable ETL pipelines at Satori Analytics. Collaborating with teams to deliver high - quality analytics solutions across various industries.
Data Architect responsible for defining enterprise data architecture on AWS and Databricks Lakehouse platforms. Enabling scalable data lakes and enterprise analytics for financial services organizations.
Data Platform Operations Support leading data engineering strategy across projects for EXL. Driving innovation and optimization while collaborating with various teams in the organization.
Manager II leading data engineering projects at Navy Federal Credit Union. Overseeing data governance and quality initiatives while managing engineering teams in a hybrid work environment.