Senior Data Engineer developing and supporting data integration and ETL solutions for Flutter UKI. Collaborating in an agile environment to deliver high-quality production code and data services.
Responsibilities
Be an effective team player of a Scrum Team - understanding and contributing to the agile delivery process and taking ownership of your team’s processes.
Create and promote the use of behaviour/test-driven development at multiple levels within the software by pairing with production code developers and product owners.
To deliver excellent production quality code and encourage and mentor other developers to do so.
To be proactive in identifying holistic approaches across diverse programs, projects and technologies.
To promote the production of reusable code and modules where appropriate with a view to maximizing effort and reducing development costs applying principles of Agile delivery.
To be proactive in the identification of opportunities to improve and rationalize applications and processes across the whole Data team, working in close collaboration with other Data team members and subject matter experts.
To liaise closely with other Data team members and subject experts to ensure that accurate and effective support documentation is maintained to reflect code development and changes.
To ensure risks and issues are identified in a timely manner and effectively communicated with proposed resolution and mitigation strategies to the Data Engineering Manager.
To be proactive and drive the building of effective relationships across Data and key areas of the Paddy Power Betfair business stakeholder community.
Write and maintain functional and technical specifications.
Monitor, optimize and trouble shoot database, microservice and stream and ML service performance.
Analyze code for problem resolution.
Thorough, demonstrable unit testing.
Requirements
Excellent SQL, preferably on both RDBMS and an MPP platform like Redshift or another big data platform like Hadoop.
Dimensional data modelling.
Demonstrable experience with high-volume data loads (terra bytes and above).
Knowledge of ETL from highly transactional (1000s records/second) OLTP systems.
Demonstrable experience of object oriented in Python.
A proven ability to influence technical decisions in a fast-moving commercial environment.
Demonstrates excellent people skills.
Demonstrates exceptional communication, interpersonal skills, and consistent high energy levels.
Proven development skills in at least one and preferably two or more of the following: Microservices, Kafka or another message based streaming platform, Machine learning and analytics in either Python or Sagemaker, Open source NoSQL technologies (e.g. MongoDB, CouchDB, ElasticSearch), ETL Tools such as Talend or Airflow, AWS (preferable) or experience of data engineering on another leading cloud vendor such as GCP or Azure.
Experience of database performance analysis and design.
Product Owner driving ERP data migration initiatives for BioNTech’s global landscape. Leading effective data management and ensuring compliance with regulatory standards in a fast - paced environment.
Data Engineer II leading development and delivery of data pipelines for Syneos Health. Collaborating with teams to optimize data processing and integrate solutions into production environments.
Lead Data Engineer overseeing data operations and analytics engineering teams for OneOncology. Focused on operational excellence in data platform and model reliability for cancer care improvement.
Senior AWS Software Data Engineer at Boeing focusing on AWS Data services to support digital analytics capabilities. Collaborating with cross - functional teams to design, develop, and maintain software data solutions.
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.