Senior Data Engineer building and maintaining robust data pipelines for various data products at Beep Saúde. Collaborating within the team and leading data governance practices.
About the role
- Cloud Data Engineer implementing customized solutions for Volkswagen in AWS data processing. Collaborating closely with experts and engaging in continuous learning.
Responsibilities
- Implement tailored solutions for our client within the Volkswagen Group for (real-time) processing and provisioning of data in the AWS environment
- Build ETL and ELT pipelines to supply analytics and machine learning applications
- Work in close collaboration with experts in your team and on the client side
- Stay at the cutting edge of technology and be willing to continuously develop your skills in cloud computing and data architecture
Requirements
- Degree in (business) computer science, electrical engineering, or a related field (or demonstrably equivalent qualification)
- Solid knowledge and experience in data provisioning and transformation
- Experience with AWS services and tools such as Amazon S3, Amazon Redshift, AWS Glue, AWS Lambda, AWS Step Functions, etc.
- Broad understanding of database concepts and technologies, including relational and NoSQL databases
- Hands-on experience with ETL/ELT tools and frameworks such as Apache Spark, Apache Airflow, AWS Glue and/or AWS Data Pipeline, Data Build Tools (e.g. dbt)
- Knowledge of data modeling and optimization for analytics and machine learning applications
- Experience programming in languages such as Python, Scala and/or similar languages
- Familiarity with common big data technologies and concepts such as Hadoop, Hive, MapReduce, Apache Kafka, as well as streaming technologies like Kinesis, Apache Flink and/or similar (desirable)
- Experience implementing and managing data pipelines and workflows
- Experience with DevOps practices and tools such as GitHub Actions/Workflows, AWS CDK, Terraform
- Ability to analyze data issues and develop effective solutions
- Experience with collaboration tools such as Confluence and Jira
- Excellent communication skills and the ability to convey technical information clearly
- Good understanding of business processes and requirements in the automotive sector (desirable)
Benefits
- Company car
- Stock participation and retirement plans
- 3 months continued salary payment in case of illness
- Company bike (JobRad)
- Home office equipment
- 8 days of training per year
- Accident insurance
- Free drinks
- After-work events (e.g. laser tag, bowling)
- Public transport and childcare subsidies
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Software Developer in Test working on cloud - based data platform at Tecsys. Ensuring quality and reliability of data pipelines and transformations using automation frameworks.
Data Engineer responsible for designing, building, and optimizing data pipelines and architectures in a tech environment. Requires extensive experience with modern data warehousing and cloud platforms.
Lead Data Engineer role at Brillio focusing on AI & Data Engineering with expertise in Azure and MS Fabric. Collaborate within the Data Engineering team in Pune, Maharashtra, India.
Data Architect at Whiteshield designing scalable, secure data architectures for national and enterprise transformation programs. Architecting modern data platforms to support analytics, AI and operational use cases.
Data Engineer managing scalable data ecosystems for actionable business intelligence and cross - functional stakeholder collaboration. Optimizing ETL/ELT pipelines and ensuring data integrity and security.
Data Engineer specializing in data architecture and solutions for a banking environment, driving value for customers through innovative engineering practices and technologies in data management.
Technical Lead for data engineering and reporting in healthcare technology at Dedalus. Shaping innovative software solutions and leading cross - functional technical teams in Australia.
Senior ML Data Engineer working on data pipeline curation for Mobileye's autonomous vehicle dataset. Collaborating across teams to enhance ML engineering and vision model applications.
Data Engineer managing customer datasets to enhance industrial research and development. Responsible for ETL pipelines and data ingestion for the Uncountable Web Platform.