Data Engineer creating and operating data pipelines in SQL Server or Azure Databricks environments. Supporting business needs and enhancing data quality for healthcare outcomes with a focus on automation.
Responsibilities
The Data Engineer creates, operates, and extends data pipelines and/or orchestration solutions built in SQL Server or Azure Databricks environments.
This role develops solutions to support the business and operational needs of internal and external partners, commonly applying SQL and ETL tools to optimize outcomes.
Design and Develop Data Pipelines: Creates and maintains robust data pipelines using Databricks, Spark, SQL, or SSIS.
ETL/ELT Processes: Develops and manages efficient ETL/ELT processes for data extraction, transformation, and loading.
Data Integration: Integrates data from various sources, ensuring data quality and consistency.
Query Writing and Optimization: Writes, optimizes, and maintains complex SQL queries to enhance performance.
Collaborate with Stakeholders: Works closely with analysts and stakeholders to understand data requirements and deliver solutions.
Performance Tuning: Optimizes data pipelines, SQL queries, and Delta Tables to ensure high performance and scalability.
Data Quality Assurance: Ensures the accuracy and reliability of data through rigorous testing and validation.
Documentation: Maintains comprehensive documentation of data pipelines, processes, and query optimizations.
Continuous Improvement: Identifies and implements opportunities for process improvements and automation.
Requirements
Bachelor’s degree in computer science, Mathematics, Statistics, or a related field.
Minimum 4 years of experience in data engineering, including:
Advanced SQL
Azure Data Factory or other ETL tools
Python or other programming languages
Azure Databricks or Spark
Azure DevOps or other CI/CD tools
Strong analytical and problem-solving skills.
Excellent communication and interpersonal skills.
Ability to work independently and as part of a team.
Strong attention to detail and ability to maintain data accuracy and integrity.
Preferred Qualifications:
Experience in healthcare, particularly specialty pharmacy.
Familiarity with healthcare data standards such as HIPAA and HITECH.
Proficiency working with Azure Log Analytics.
Knowledge of dimensional data modeling.
Data Warehousing Experience
Benefits
Hybrid, remote and flexible on-site work schedules are available, based on the position.
PANTHERx Rare Pharmacy also affords an excellent benefit package, including but not limited to medical, dental, vision, health savings and flexible spending accounts, 401K with employer matching, employer-paid life insurance and short/long term disability coverage, and an Employee Assistance Program!
Generous paid time off is also available to all full-time employees, as well as limited paid time off for part-time employees.
Senior Data Engineer at Keyrus leading the design, development, and delivery of scalable data platforms. Collaborating with teams to translate requirements into production - grade solutions and mentoring engineers.
Senior Data Engineer for global payments platform designing ETL pipelines and data models. Collaborating across teams to tackle complex data challenges in an innovative fintech environment.
Data Warehouse Modelling Engineer designing and maintaining data models using Data Vault 2.0 for iGaming industry. Collaborating with stakeholders and optimizing data models in a hybrid work environment.
Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.