Big Data Engineer focused on architecting and deploying scalable Apache Spark environments. Working on Nebul’s sovereign AI cloud to enhance data performance and security.
About the role
- Data Engineer responsible for managing and supporting cloud data platforms. Collaborating with teams to ensure stable and efficient cloud data operations in Azure.
Responsibilities
- Resolve data pipeline issues and perform proactive monitoring for sensitive and critical batch processes.
- Conduct Root Cause Analysis (RCA) and retrospectives for incidents and operational issues.
- Create, update, and maintain operational runbooks and manage entitlements as required.
- Implement configuration changes to batch processes and underlying cloud infrastructure.
- Manually control and manage pipeline executions during scheduled maintenance windows.
- Perform on-demand operational changes based on instructions provided by the Data Engineering (L3) team.
- Handle user service requests; for non-runbook-based requests, coordinate effectively with the L3 team.
- Participate in Disaster Recovery (DR) testing activities (twice a year).
- Support development and production data synchronization activities.
- Represent the team in weekly change management board meetings.
Requirements
- Bachelor’s degree in Computer Science or a related field.
- 3–6 years of hands-on experience in configuring and managing Azure-based data analytics solutions.
- Prior experience working in Azure cloud environments is strongly preferred.
Benefits
- Schedule flexibility required, including regular weekend and holiday coverage to support 24×7 operations
- Occasional travel may be required (less than 10%)
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
BI Specialist focusing on data architecture and insights for RPE. Collaborating with business and technology teams to enhance data governance and analytics.
Technical Lead responsible for delivering innovative software solutions for the healthcare sector. Leading technical teams and ensuring compliance with governance standards across Australia and New Zealand.
Senior Data Engineer dedicated to designing and optimizing cloud data solutions at Leega, a consulting firm focused on innovative client service.
Data Engineer optimizing data integrations for Retail industry. Combine multiple data sources and design ETL workflows while maintaining data quality and security.
Enterprise Data Architect shaping and executing data architecture to support Energy Trust of Oregon's objectives. Collaborating on standards and governance for effective data use.
Senior Data Engineer responsible for building high - performance data pipelines for satellite analytics. Collaborating with ML Engineers and product teams to enable actionable insights from satellite data.
IT Business Solutions Analyst - Data Engineer at JTI collaborating on centralized systems and data - driven solutions while ensuring governance and compliance.
Senior Manager - Data Architect leading enterprise - level data architectures and cloud data platforms. Working in a hybrid consulting environment focused on AI - driven decision - making in Switzerland.
Data Engineer developing tools and analytical capabilities for tracking commodity flows within the Dry Bulk market. Lead data interventions and engage with cross - functional teams for efficient cargo data management.