Senior Software Engineer contributing to Workday's AI/MLOps cloud ops platform. Involves data ingestion, computation, and generation of curated data sets with modern technologies.
About the role
- Mid/Senior Data Engineer building centralized data lake for Yassir. Collaborating on analytics projects and developing data processing pipelines.
Responsibilities
- Build a centralized data lake on GCP by integrating diverse data sources
- Develop, maintain, and optimize SPARK-powered data processing pipelines
- Design and implement data validation and quality checks
- Collaborate with Data Science and ML teams for analytics
- Collaborate with cross-functional teams for data insights
- Design, develop, and maintain data dashboards
- Manage ETL/ELT processes and troubleshoot data issues
Requirements
- 5+ years of experience in data engineering
- Proficient in PySpark for batch and streaming
- Strong skills in GCP services (Dataproc, Dataflow, BigQuery)
- NoSQL experience, preferably with MongoDB
- Programming skills in Scala/Python
- Understanding of Data Governance and Data Modelling
- Good SQL knowledge
- Effective communication skills
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Data Engineer role at Citi designing and maintaining scalable data solutions. Seeking a skilled professional with extensive data engineering experience and expertise in various technologies.
Data Engineer responsible for designing and maintaining enterprise data warehouse for various projects. Collaborating with stakeholders to ensure efficient data flow and integration.
Data Engineer developing and evolving BI platform for Thomson Reuters in India. Building architectural solutions and collaborating in all development lifecycle aspects.
Data Engineer responsible for building and maintaining AWS Lakehouse infrastructure for trade contractors at Remarcable. Focused on clean data architecture and AI/ML data infrastructure.
Senior Data Engineer joining Reconomy to design, build and optimize data pipelines for an international circular economy specialist.
Data Engineer/Analyst maintaining and improving data infrastructure for Braiins. Collaborating with technical and business teams to ensure reliable data flows and insights.
Medior Data Engineer handling Azure migrations for a major urban mobility client. Focused on data pipeline development and ensuring platform reliability with cutting - edge technologies.
Developing ML and computer vision solutions for cutting - edge autonomous vehicle dataset pipeline at Mobileye. Collaborating across teams for data curation and advanced perception algorithms.
Data Migration Lead in a hybrid role managing data migration for a major transformation programme in the media sector. Collaborating with various teams to ensure data integrity and successful migration.