Senior Data Engineer building and maintaining robust data pipelines for various data products at Beep Saúde. Collaborating within the team and leading data governance practices.
About the role
- Data Engineer facilitating seamless data transfer between systems for MassMutual Romania. Collaborating with teams on data migration and transformation initiatives in a hybrid role.
Responsibilities
- Facilitate seamless data transfer between systems, ensuring uninterrupted business operations.
- Implement efficient migration processes to minimize downtime and reduce costs.
- Plan and execute assigned transformations tasks within deadlines.
- Create and maintain the import/export configuration files based on the mapping requirements.
- Investigate, analyze and document reported configuration defects.
- Fine tune the transformations/configurations.
- Write clean and well-structured transformations.
- Review and recommend changes to existing transformations processes.
- Configure various modules to meet specific business requirements.
- Monitor and troubleshoot common and daily tasks and events as well as changes.
- Provide post configuration implementation support.
- Ensure the transformations are according to the business requirements.
- Work directly with business analysts and the development team to identify needs and resolve software configuration problems.
- Prepare the setup and deployment of newly implemented transformations.
- Deploy on non-production environments for testing purposes.
Requirements
- Experience with a programming language - preferably Python with PySpark.
- Experience in working with relational databases.
- Experience in working with different types of files.
- Experience with using API tools like Postman, SoapUI.
- Experience with using AWS.
- Ability to express clearly the thought process into pseudo-code.
- Strong analytical and problem-solving skills to identify and resolve data migration/transformation issues.
- Experience with scripting language is a plus.
- Experience in working with large data sets is a plus.
Benefits
- Health insurance
- Flexible work arrangements
- Professional development opportunities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Software Developer in Test working on cloud - based data platform at Tecsys. Ensuring quality and reliability of data pipelines and transformations using automation frameworks.
Data Engineer responsible for designing, building, and optimizing data pipelines and architectures in a tech environment. Requires extensive experience with modern data warehousing and cloud platforms.
Lead Data Engineer role at Brillio focusing on AI & Data Engineering with expertise in Azure and MS Fabric. Collaborate within the Data Engineering team in Pune, Maharashtra, India.
Data Architect at Whiteshield designing scalable, secure data architectures for national and enterprise transformation programs. Architecting modern data platforms to support analytics, AI and operational use cases.
Data Engineer managing scalable data ecosystems for actionable business intelligence and cross - functional stakeholder collaboration. Optimizing ETL/ELT pipelines and ensuring data integrity and security.
Data Engineer specializing in data architecture and solutions for a banking environment, driving value for customers through innovative engineering practices and technologies in data management.
Technical Lead for data engineering and reporting in healthcare technology at Dedalus. Shaping innovative software solutions and leading cross - functional technical teams in Australia.
Senior ML Data Engineer working on data pipeline curation for Mobileye's autonomous vehicle dataset. Collaborating across teams to enhance ML engineering and vision model applications.
Data Engineer managing customer datasets to enhance industrial research and development. Responsible for ETL pipelines and data ingestion for the Uncountable Web Platform.