Data Engineer ETL responsible for AI model data cleaning and development. Leading projects in a hybrid work environment in Singapore.
About the role
- Data Engineer at PG&E focusing on data extraction and transformation solutions in the Electric Operations unit. Leading teams for complex data issues and ensuring data quality.
Responsibilities
- Designs, develops, modifies, configures, debugs and evaluates jobs for extracting data from various sources, implements transformation logic, and stores data in various formats fit for use by stakeholders.
- Collects metadata about jobs including data lineage and transformation logic.
- Works with teams, clients, data owners, and leadership throughout the development cycle practicing continuous improvement.
- Leads a team on moderately complex to complex data and analytics-centric problems having broad impact that require in-depth analysis and judgment to obtain results or solutions.
- Identifies, designs and implements internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
- Resolves application programming analysis problems of broad scope within procedural guidelines.
- Provides assistance to other programmers/analysts on unusual or especially complex problems that cross multiple functional/technology areas.
- Conceptualizes and generates infrastructure that allows big data to be accessed and analyzed with verified data quality and metadata is appropriately captured and catalogued.
- Collaborates with peers to develop departmental standards, norms, and new goals/objectives.
- Plans work to meet assigned general objectives; reviews progress regularly and solutions may provide an opportunity for creative/non-standard approaches.
- Assesses data pipeline performance and suggests/implements changes as required.
- Communicates (oral and written) recommendations.
- Mentors/provides guidance to less experienced colleagues.
Requirements
- BA/BS in Computer Science, Management Information Systems or related field of study, or equivalent experience
- 7 years of experience with data engineering/ETL ecosystems such as Palantir Foundry, Spark, Informatica, SAP BODS, OBIEE
- Experience with multiple data engineering/ETL ecosystems
- Experience with machine learning algorithm deployment
- Master’s degree in Computer Science, Management Information Systems or related field, or equivalent experience (desired)
- Experience leading development teams
- Business Intelligence and data access tool expertise, including advanced SQL, data modeling, and performance optimization.
- Strong software engineering fundamentals (Git, CI/CD, unit and integration testing) with production data pipelines experience
- Proficiency in Python and SQL within Palantir Foundry, including PySpark-based transformations and data workflows
Benefits
- This job is also eligible to participate in PG&E’s discretionary incentive compensation programs.
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
EU Commercial Data Engineer developing scalable data solutions for Genmab’s commercial teams. Collaborating with cross - functional teams to enhance business insights and decision making through reliable data.
Principal Data Engineer designing and developing innovative data analytical solutions for the gaming industry. Leading and mentoring while engaging with clients to fulfill their data engineering needs.
Specialist, Data Engineering at CoverMyMeds enhancing and expanding data platforms for commercial data products. Collaborating with multiple teams to design scalable data solutions from various sources.
Team Lead in Data Engineering at Avanquest mentoring data engineering team and ensuring efficient data management across platforms. Collaborating with departments to align solutions and optimize workflows.
Data Architect at RSM leading AI - driven data migration initiatives within Salesforce ecosystem. Implementing data governance and optimizing performance across complex datasets.
Senior Data Engineer at Capgemini designing and optimizing scalable data architectures on Databricks and GCP. Collaborating across teams to transform business needs into reliable technical solutions.
Data Engineer transforming legacy on - premises systems to cloud - native architectures for advanced data analytics. Collaborating with teams to build efficient data solutions using Python and AWS.
Data Engineering Academy focused on Snowflake and Databricks for professionals interested in expanding their technical capabilities. Fully remote with future office work in Monterrey or Saltillo after completion.
Senior Data Engineer at Intent HQ designing and scaling data platforms. Building high - impact intelligence from millions of customer insights with a focus on performance and reliability.