Data Engineer Manager at PwC focusing on building data infrastructure and solutions. Leading data engineering projects to transform raw data into actionable insights and drive business growth.
About the role
- Senior Data Engineer at innovative asset management provider designing data infrastructure for the energy sector. Collaborating with teams to enable machine learning and optimize renewable resources.
Responsibilities
- Design, develop, and optimize data infrastructure for reliable ingestion and processing of large-scale time-series data.
- Collaborate with cross-functional teams and communicate results effectively.
- Enable advanced machine learning and data-driven decisions for renewable energy optimization worldwide.
Requirements
- **Data Architecture & Strategy:** Lead the design and implementation of robust data architectures and pipelines that support real-time and batch processing of wind and solar datasets.
- **Data Integration & Transformation:** Oversee the ingestion and harmonization of diverse data sources, ensuring reliability, consistency, and performance.
- **ETL & Orchestration:** Build, maintain, and optimize ETL/ELT processes with a focus on scalability, modularity, and reusability.
- **Database Engineering:** Design and manage high-performance data warehouses and time-series databases (e.g., TimescaleDB, PostgreSQL, MySQL).
- **Quality & Governance:** Implement automated data validation, quality checks, and monitoring systems to ensure integrity across the data lifecycle.
- **DevOps Collaboration:** Contribute to CI/CD processes and containerization (e.g., Docker) to support robust and agile data delivery.
- **API Integration:** Develop and maintain interfaces for seamless data access and integration with internal and external systems.
- **Cross-Functional Collaboration:** Partner with product, analytics, and machine learning teams to understand business needs and translate them into data solutions.
- **Documentation & Knowledge Sharing: **Promote best practices through comprehensive documentation and mentorship of junior engineers.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Junior Data Engineer at OneMarketData focusing on data quality and integrity in financial datasets. Collaborating with senior analysts and assisting in data management and analysis tasks.
Data Engineer Manager leading robust data solutions for PwC's clients. Transforming raw data into actionable insights and coaching team members.
Senior Data Engineering Analyst developing and implementing data solutions. Collaborating in a diverse environment focused on data processing and analysis for clients' digital transformation.
Principal Software Engineer in Threat Data Platform developing AI - driven tools for threat intelligence automation. Collaborating on robust data pipelines for PANW’s product ecosystem.
Senior Azure Data Engineer maintaining business intelligence solutions for Grupo Gloria, implementing and stabilizing projects in Azure and Databricks with Power BI reporting.
Staff Data Engineer at URBN developing AI - powered digital experiences by integrating algorithmic solutions with creative tools. Collaborating with cross - functional teams for impactful product evolution.
Senior Data Engineer at Anglian Water responsible for scalable data solutions and team collaboration. Leading design, build, and operation of secure data pipelines for critical services.
Data Engineer developing complex data pipelines for Symphony, a global software company. Collaborating with teams and driving data solutions in a hybrid work environment.
Data Engineer focused on building and maintaining data pipelines using SQL Server and T - SQL. Designing data solutions for reporting and analytics from various internal and third - party systems.