Senior Data Engineer at Keyrus leading the design, development, and delivery of scalable data platforms. Collaborating with teams to translate requirements into production - grade solutions and mentoring engineers.
SH
Hybrid Principal Data Engineer – Azure Cloud, PySpark, Databricks, Data Factory
Posted 2 months ago
About the role
- Principal Engineer providing leadership and clean solutions based on Big Data applications at Syneos Health. Engaging with clients and ensuring adherence to best practices in cloud solutions.
Responsibilities
- Provide technical leadership and guidance to teams and clients throughout the solution lifecycle
- Troubleshoot and resolve complex issues related to Cloud based Data Lake and Data Mesh environments
- Stay current with emerging technologies and trends and recommend best practices
- Design, develop, and implement scalable and secure cloud solutions for Big Data Platforms interfacing with API, file, SQL databases
- Architect and optimize data pipelines using distributed cloud computing to ensure that they support high volume / high velocity data streams and are scalable to meet growth expectations
- Develop guidelines and plans for performance tuning of a Big Data /NoSQL environment with underlying impact analysis of distributed jobs to enhance data processing, analytics, and machine learning capabilities
- Implement a mixed batch/near-real time architecture to analyze, index, and publish data for applications
- Develop and implement strategies for data governance, security, and compliance
- Create and maintain comprehensive documentation for solution designs, configurations, and best practices
- Provide training and support to clients and internal teams on solution architecture
- Engage with clients to understand their business needs and deliver tailored cloud solutions
- Conduct presentations, demos, and workshops to showcase Data Lake Capabilities
Requirements
- Bachelor’s degree in computer science, Engineering, or a related field; advanced degree preferred
- Strong experience with Azure Cloud, PySpark, Databricks and Data Factory
- SME in cloud engineering or solution architecture with a focus on Azure and related capabilities
- Demonstrated ability to engage both developers and business partners to achieve target outcomes
- Experience with DevOps and best practices for Coding in a distributed Cloud environment
- Command of Data Movement, Analysis, Modeling best practices
- Excellent written and verbal communications;
- Solid written and oral presentation skills
- Excellent problem-solving skills, strong communication abilities, and the ability to work collaboratively in a team environment
- Demonstrated ability to define business use cases and measure / communicate proposed project benefits
Benefits
- Career development and progression
- Supportive and engaged line management
- Technical and therapeutic area training
- Peer recognition
- Total rewards program
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Entry - level Data Engineer in Product Data Group at NGINX. Building scalable data pipelines and collaborating with engineers.
Senior Data Engineer for global payments platform designing ETL pipelines and data models. Collaborating across teams to tackle complex data challenges in an innovative fintech environment.
Data Engineer transforming data for analysis in an insurance company. Responsible for building data infrastructures and optimizing data delivery.
Senior Data Engineer for the MDM Data Product Team at Avenga. Responsible for provisioning data from master data customer and product systems.
Data Warehouse Modelling Engineer designing and maintaining data models using Data Vault 2.0 for iGaming industry. Collaborating with stakeholders and optimizing data models in a hybrid work environment.
Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.
Data Engineer Manager at PwC focusing on building data infrastructure and solutions. Leading data engineering projects to transform raw data into actionable insights and drive business growth.