Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
About the role
- Data Engineer creating data pipelines in Databricks for a fast-growing digital banking platform. Responsible for ensuring data quality and optimising processes to support decision-making.
Responsibilities
- Design, develop, test, deploy and monitor data pipelines in Databricks on AWS from a wide variety of data sources.
- Design, develop, test, deploy and monitor scalable code with PySpark and SQL in Databricks.
- Identify opportunities to improve internal process through code optimisation and automation.
- Build data quality dashboards, lineage flows / and or monitoring tools to utilize the data pipeline, providing active monitoring and actionable insight into overall data quality and data governance.
- Assist in migrating data from legacy systems onto newly developed solutions.
- Follow and lead best practices on all data security, retention, and privacy policies.
Requirements
- Bachelor’s degree.
- ** 3+ years’ experience of building ETL/ELT pipelines.**
- Proven competency in solution design, development, implementation, reporting and analysis.
- Proficiency in **Apache-Spark, Python and SQL languages**.
- Proficiency in working with **Text, Delta, Parquet, JSON, CSV, and XML data formats.**
- Working knowledge of Spark structured streaming.
- **AWS infrastructure experience, specifically working with S3.**
- **Solid understanding of git-based version control, DevOps, and CI/CD. Experience of working on Atlassian stack a plus.**
- **Knowledge of common web API frameworks and web services.**
- Strong teamwork, relationship, and client management skills, and the ability to influence peers and senior management to accomplish team goals.
- Willingness to embrace modern technology, best practice, and ways of work.
Benefits
- Performance bonus up to 2 months
- 13th month salary pro-rata
- 15-day annual leave+ 3-day sick leave + 1 birthday leave + 1 Christmas leave
- Meal and parking allowance are covered by the company.
- Full benefits and salary rank during probation.
- Insurances as Vietnamese labor law and premium health care for you and your family without seniority compulsory
- SMART goals and clear career opportunities (technical seminar, conference, and career talk) - we focus on your development.
- Values-driven, international working environment, and agile culture.
- Overseas travel opportunities for training and working related.
- Internal Hackathons and company's events (team building, coffee run, blue card...)
- Work-life balance 40-hr per week from Mon to Fri.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.
Data Engineer delivering AI - and data - driven solutions for Honeywell’s industrial customers. Architecting and implementing scalable data pipelines and platforms focused on IoT and real - time data processing.
Data Engineering Associate focusing on data quality control and management for distribution platform. Collaborates on large scale data projects to ensure data accuracy and availability for users.
Data Architect managing enterprise data platform built on Microsoft Fabric at Johnstone Supply. Leading architectural standards and collaborating with business and IT leaders for strategic data - driven insights.
Data Engineer at Studyportals responsible for data pipelines and infrastructure. Join a team ensuring accurate and trustworthy data for analytics and business decisions.
AI/ML Engineer designing and refining prompts and workflows using large language models. Responsible for developing data pipelines and delivering scalable AI solutions in a hybrid work environment.
AWS Data Architect at Fractal designing and operationalizing AWS data solutions at enterprise scale. Collaborating with clients and mentoring engineers in best practices.