Data Architect designing and implementing analytics and reporting solutions for Taylor Corporation. Collaborating with stakeholders and leading data modeling efforts in a hybrid environment.
About the role
- Senior Data Engineer designing and maintaining cloud data solutions using Spark and Databricks. Collaborating with teams and clients to optimize data infrastructure and insights delivery.
Responsibilities
- Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and Databricks.
- Gather and analyze data requirements from business stakeholders and identify opportunities for data-driven insights.
- Build and optimize data pipelines for data ingestion, processing, and integration using Spark and Databricks.
- Ensure data quality, integrity, and security throughout all stages of the data lifecycle.
- Collaborate with cross-functional teams to design and implement data models, schemas, and storage solutions.
- Optimize data processing and analytics performance by tuning Spark jobs and leveraging Databricks features.
- Provide technical guidance and expertise to junior data engineers and developers.
- Stay up-to-date with emerging trends and technologies in cloud computing, big data, and data engineering.
- Contribute to the continuous improvement of data engineering processes, tools, and best practices.
Requirements
- Bachelor's or Master's degree in computer science, engineering, or a related field.
- 10+ years of experience as a Data Engineer, Software Engineer, or similar role, with a focus on building cloud-based data solutions.
- Strong experience with cloud platforms such as Azure or AWS.
- Proficiency in Apache Spark and Databricks for large-scale data processing and analytics.
- Experience in designing and implementing data processing pipelines using Spark and Databricks.
- Strong knowledge of SQL and experience with relational and NoSQL databases.
- Experience with data integration and ETL processes using tools like Apache Airflow or cloud-native orchestration services.
- Good understanding of data modeling and schema design principles.
- Experience with data governance and compliance frameworks.
- Excellent problem-solving and troubleshooting skills.
- Strong communication and collaboration skills to work effectively in a cross-functional team.
- Relevant certifications in cloud platforms, Spark, or Databricks are a plus.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
BI Data Engineer designing and optimizing Power BI dashboards for Rabobank's Payments & Savings data. Collaborating with cross - functional teams to provide actionable insights from large data sets.
Lead Data Engineer providing technical expertise and mentoring at Westpac. Ensuring platform stability and compliance while driving engineering practices within the squad.
Data Engineer at Uline delivering custom data warehousing solutions for shipping materials distribution. Responsibilities include ETL workflows and data integration management.
MDM Data Engineer managing Profisee MDM platform for Pacific Life. Responsible for data quality, integration and technical support across enterprise systems.
Data Engineer responsible for designing and developing cloud - based data pipelines for ING. Collaborating with international teams focusing on financial risk analytics in the cloud environment.
Data Engineer specializing in SQL and datamigration processes for the municipality of Amsterdam. Collaborating with diverse stakeholders to ensure data integrity and accessibility.
Senior Expert in Data Architecture at OMV Group based in Romania. Leading data governance strategy and managing complex data management responsibilities.
Senior BI and Data Engineer developing innovative BI solutions in the Tech for Good space. Collaborating to enhance STEM education through effective data practices.
Data Engineer creating scalable, reliable data solutions for Retail Insight's clients and enhancing the data ecosystem. Collaborating with software engineers to ensure data quality and accessibility.