Design and maintain data pipelines for enterprise analytics and reporting, using SQL Server and Azure technologies. Collaborate with stakeholders to ensure data quality and performance optimization.
Responsibilities
Design, build, and maintain data pipelines and infrastructure supporting enterprise analytics and reporting
Develop and maintain incremental data pipelines using SSIS, PySpark notebooks, and Python
Implement and optimize ETL/ELT processes for Azure SQL databases and data lake environments
Build meta-driven, scalable data ingestion frameworks supporting SCD Type 2 methodology
Write and optimize T-SQL stored procedures, views, and dynamic SQL for data transformations
Develop Python-based automation including Azure Functions, blob triggers, and API integrations
Maintain data quality, perform root cause analysis, and resolve data pipeline issues
Support CI/CD processes including code reviews, Git version control, and Azure DevOps workflows
Monitor pipeline performance and implement optimization strategies
Assist with data modeling, indexing strategies, and schema evolution
Collaborate with business stakeholders and Analytics team to meet reporting requirements
Participate in data platform modernization and improvement initiatives
Requirements
Proficiency with SQL Server, T-SQL, and database concepts (indexing, query optimization)
Experience with ETL/ELT tools and concepts (SSIS or similar preferred)
Understanding of data warehousing, dimensional modeling, and SCD methodologies
Familiarity with Azure cloud services (especially Azure SQL Database)
Ability to troubleshoot data issues and perform data analysis
Strong problem-solving skills and attention to detail
Experience with version control (Git) and collaborative development
Senior Manager leading a team of database engineers to manage CCC's data platform. Overseeing mission - critical applications and collaborating with cross - functional teams in a hybrid environment.
As a Principal Data Architect at Solstice, lead the design and implementation of data architecture solutions. Ensure data integrity, security, and accessibility to meet strategic organizational goals.
Data Platform Specialist overseeing data workflows and enhancing data quality for Stackgini's AI - driven IT solutions. Collaborating with teams to drive improvements and stakeholder support.
Data Engineer designing data pipelines in Python for a major railway industry client. Collaborate with Data Scientists and ensure code quality with agile methodologies.
Senior Data Engineer responsible for building and optimizing data pipelines for banking analytics initiatives. Collaborating with data teams to ensure data quality and readiness for enterprise use.
Senior Data Engineer developing scalable data solutions on Databricks for analytics and operational workloads. Collaborating with cross - functional teams to modernize the data ecosystem.
Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.