Data Engineer ETL responsible for AI model data cleaning and development. Leading projects in a hybrid work environment in Singapore.
About the role
- Senior Data Engineer developing Azure-based data solutions for clients in the Data & AI department. Collaborating with architects and consultants to enhance automated decision making.
Responsibilities
- Understand customer requirements and work collaboratively to design data solutions that deliver high quality outcomes.
- Enable higher quality data to be created & managed in our customers organisations
- Develop high quality data products utilising (primarily) cloud native patterns
- Engineer cloud-based data lake patterns to connect and leverage organisational & external data
- Provide technical support and guidance through prototyping, testing, build, and launch of data products
- Contribute towards the creation of technical support and design documentation for data platforms and solutions .
- Contribute to continually refining our development standards and best practices.
Requirements
- Strong technical expertise using core Microsoft Azure data technologies: Data Factory, Databricks, Data Lake, Azure SQL, Synapse, Data Catalog , Purview
- A strong background in Python development (for data engineering) and SQL
- Proficient with Azure databases such as Synapse EDW, SQL Managed Instance, and Azure SQL
- Skilled in Devops (CI/CD) implementations. Including IaC deployments (Bicep, Terraform, etc.)
- Adept at team collaboration and task tracking with Azure DevOps, adhering to Scrum/Agile methodologies.
- Knowledge and experience of the following would be advantageous : C# development skills
- Azure services used for infrastructure build and monitoring (ARM, Policy, Monitor, Log Analytics etc)
- Implementation of big data/analytics services
- Supporting AI/Machine Learning workflows at production-level scale
- NoSQL databases such as Cosmos DB or Mongo DB
- Knowledge of Microsoft Fabric and its requisite platform components, as well as monitoring, security and governance configuration within the platform
- Experience in working with Power BI, including Power Query, DAX, and Power BI Service.
Benefits
- A collaborative and supportive environment in which you can grow and develop your career
- The tools and opportunity to do work you can be proud of
- A chance to work alongside some of the best people in the industry, who always seek to share their knowledge and experience
- Hybrid working – we empower you to make smart choices about when and where to work to achieve great results
- Industry leading coaching and mentoring
- Competitive salary and an excellent benefits package
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
EU Commercial Data Engineer developing scalable data solutions for Genmab’s commercial teams. Collaborating with cross - functional teams to enhance business insights and decision making through reliable data.
Principal Data Engineer designing and developing innovative data analytical solutions for the gaming industry. Leading and mentoring while engaging with clients to fulfill their data engineering needs.
Specialist, Data Engineering at CoverMyMeds enhancing and expanding data platforms for commercial data products. Collaborating with multiple teams to design scalable data solutions from various sources.
Team Lead in Data Engineering at Avanquest mentoring data engineering team and ensuring efficient data management across platforms. Collaborating with departments to align solutions and optimize workflows.
Data Architect at RSM leading AI - driven data migration initiatives within Salesforce ecosystem. Implementing data governance and optimizing performance across complex datasets.
Senior Data Engineer at Capgemini designing and optimizing scalable data architectures on Databricks and GCP. Collaborating across teams to transform business needs into reliable technical solutions.
Data Engineer transforming legacy on - premises systems to cloud - native architectures for advanced data analytics. Collaborating with teams to build efficient data solutions using Python and AWS.
Data Engineering Academy focused on Snowflake and Databricks for professionals interested in expanding their technical capabilities. Fully remote with future office work in Monterrey or Saltillo after completion.
Senior Data Engineer at Intent HQ designing and scaling data platforms. Building high - impact intelligence from millions of customer insights with a focus on performance and reliability.