Data Engineer creating advanced data solutions for Mastercard, a global payments technology company. Collaborate cross-functionally to implement robust data pipelines and architectures.
Responsibilities
Gather and understand the data engineering requirements based on the product and Engineering specifications
Conduct data discovery to build data models, schemas, tables, view, schemas deployment and many more
Building appropriate data pipelines in the application to support ETL and automate the pipelines
Build or use existing tools to execute one time ad-hoc data engineering asks
Implement and manage CI/CD pipelines using GitLab and Jenkins, enabling automated testing, deployment, and monitoring of data workflows
Build fact tables, conduct analysis and reporting as per needs
Conduct data analysis and perform data operations to support business decisions
Provide architecture guidelines and support from Data engineering aspects in product development
Apply exceptional problem-solving and analytical skills to troubleshoot complex data and system issues
Support Data Science team in building model deployment, data pipelines, serving etc
Document pipeline architecture, processes, and standards, promoting consistency and transparency across the team
Learn latest trends in data engineering concepts, tools and share with wider organization in brown bags etc
Provide thought leadership within this area for the entire department
Work with TPMs, product and relevant stakeholders while executing Data engineering assignments by leading the plan
Requirements
Expert in SQL development with hands-on experience in Databricks, Snowflake, Python, and PySpark for designing and implementing advanced data engineering solutions
Proven experience collaborating with stakeholders and cross-functional teams to understand business requirements and deliver reliable, high-impact cloud data solutions across Azure, AWS, and Cloud Data Warehouse platforms
Strong leadership and communication skills, with the ability to guide and mentor data engineering teams, ensuring effective collaboration between technical and non-technical stakeholders
Skilled in architecting and developing scalable, reusable data models, pipelines, and frameworks leveraging Hadoop, NiFi, and modern cloud Data Lake architectures
Experienced in planning and executing end-to-end deployments, upgrades, and migrations with minimal disruption to operations, ensuring adherence to best practices in cloud-native and distributed systems
Holds a Bachelor’s degree in Computer Science
Good understanding of payment networks
Skill in identifying new product ideas from data
Experience publishing and protecting scientific intellectual property work
Benefits
insurance (including medical, prescription drug, dental, vision, disability, life insurance)
flexible spending account and health savings account
paid leaves (including 16 weeks of new parent leave and up to 20 days of bereavement leave)
80 hours of Paid Sick and Safe Time
25 days of vacation time and 5 personal days, pro-rated based on date of hire
10 annual paid U.S. observed holidays
401k with a best-in-class company match
deferred compensation for eligible roles
fitness reimbursement or on-site fitness facilities
Data Platform Expert developing and maintaining data solutions for analysis and reporting at Magna Electronics. Collaborating with various teams to enhance data - driven decision making and insights.
Data Engineer at Mobiz designing, building, and maintaining scalable data solutions for analytics. Collaborating with teams to leverage modern cloud technologies and improve data - driven decision - making.
Head of Data Engineering at Envitia overseeing data architecture services for public sector programs. Leading service mobilization with client stakeholders in a hybrid work environment.
Applied AI Health Data Architect - Senior Manager at PwC designing data architecture for healthcare operations. Contributing to innovative data solutions and mentoring teams for operational excellence.
CRM Functional Data Migration Engineer at Data - Core Systems, Inc. managing Dynamics 365 CE solutions and delivering technical expertise in a consulting role.
Data Engineer role for Alberta Securities Commission, focusing on data pipelines and infrastructure. Involves designing, building, and securing data assets for organizational decision - making.
Data Architect supporting UK MOD programme delivering data and integration capabilities for Defence. Join Amentum's growing IT team focused on critical national infrastructure and security projects.
Data Engineer joining Contour Software's development team to handle various big data projects. Focus on cloud data lake architecture and machine learning implementation.
Enterprise Architect Sr position at PNC collaborating with technology stakeholders to build enterprise data architecture. Focus on data models, governance, and guiding data decisions for business strategy.
Data Engineer architecting and maintaining data products using Databricks and Power BI for Nitro's digital transformation efforts. Collaborating to optimize processes and leverage cloud technologies.