Senior Data Engineer at Red Hat designing and optimizing 데이터 솔루션 supporting sales and forecasting. Collaborating with teams and applying modern data engineering practices to ensure data quality.
About the role
- Senior Data Engineer leading a team of Data Engineers at Optasia, a fintech company. Responsible for building data infrastructure and delivering scalable data solutions.
Responsibilities
- Lead, mentor, and support a team of Data Engineers, fostering collaboration, technical excellence, and professional growth.
- Provide technical expertise and direction in data engineering, guiding the team to deliver high quality scalable data analytical pipelines.
- Support the testing, selection and deployment of data engineering tools, technologies, and methodologies.
- Design, build, and optimize end-to-end batch and streaming data analytical pipelines.
- Develop, maintain, and evolve the company’s big data infrastructure and core libraries for large-scale ingestion and processing.
- Work closely with Solution Architects, Data Assurance Engineers, ML Engineers, and System Administrators for the design, delivery, and support of end-to-end data workflows.
- Drive best practices in code quality, testing, CI/CD, and data governance, ensuring scalability, performance, and compliance with data protection regulations (e.g., GDPR).
- Conduct code reviews, align coding standards, and oversee configuration management of the big data infrastructure.
Requirements
- Bachelor’s or Master’s degree in Computer Science or Informatics.
- 3+ years of experience in Data Engineering.
- Strong hands-on expertise with the Apache Hadoop ecosystem (HDFS, Hive, Spark, YARN).
- Proficiency in Scala, Java, Python, SQL, scripting (Bash/Python).
- Experience with relational and NoSQL technologies.
- System administration skills in Linux.
- Practical experience with deployment, configuration, and maintenance of distributed systems and data/software engineering tools.
- Experience with CI/CD orchestration.
- Worked extensively in Hadoop / Spark / Spark Streaming / Hive (optional).
- Experience with data and ML flow engines and tools, e.g. Apache Airflow, Apache NiFi, Druid (optional).
- Hands-on exposure to modern data lake storage and table formats, e.g. Apache Iceberg, Apache Hudi (optional).
- Experience in working with secure code development guidelines and coding practices (i.e. OWASP, NIST) (optional).
Benefits
- 💸 Competitive remuneration package
- 🏝 Extra day off on your birthday
- 💰 Performance-based bonus scheme
- 👩🏽⚕️ Comprehensive private healthcare insurance
- 💻 All the tech gear you need to work smart
- 🎌 Be a part of a multicultural working environment
- 🎯 Meet a very unique and promising business and industry
- 🌌 Gain insights for tomorrow market’s foreground
- 🎓 A solid career path within our working family is ready for you
- 📚 Continuous training and access to online training platforms
- 🥳 CSR activities and festive events within any possible occasion
- 🍜 Enjoy comfortable open space restaurant with varied meal options every day
- 🎾 🧘️ Wellbeing activities access such as free on-site yoga classes, plus available squash court on our premises
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer leading the design and implementation of data pipelines for NVIDIA’s analytics and monitoring systems. Collaborating across teams to enhance data ingestion and analysis capabilities.
Associate Data Engineer at Boeing India supporting API Development and Data migration with a focus on engineering and technology solutions. Involves working independently to gather requirements and supporting architecture for API services and data analytics.
Senior Data Engineer building and maintaining robust data pipelines for various data products at Beep Saúde. Collaborating within the team and leading data governance practices.
Software Developer in Test working on cloud - based data platform at Tecsys. Ensuring quality and reliability of data pipelines and transformations using automation frameworks.
Data Engineer responsible for designing, building, and optimizing data pipelines and architectures in a tech environment. Requires extensive experience with modern data warehousing and cloud platforms.
Lead Data Engineer role at Brillio focusing on AI & Data Engineering with expertise in Azure and MS Fabric. Collaborate within the Data Engineering team in Pune, Maharashtra, India.
Data Architect at Whiteshield designing scalable, secure data architectures for national and enterprise transformation programs. Architecting modern data platforms to support analytics, AI and operational use cases.
Data Engineer managing scalable data ecosystems for actionable business intelligence and cross - functional stakeholder collaboration. Optimizing ETL/ELT pipelines and ensuring data integrity and security.
Data Engineer specializing in data architecture and solutions for a banking environment, driving value for customers through innovative engineering practices and technologies in data management.