Data Engineer/Solution Architect leading the design and optimization of data platforms for Jetfly Group. Collaborating with stakeholders and mentoring junior engineers to enhance data engineering practices.
Responsibilities
Lead the end-to-end design, development, deployment and maintenance of data pipelines using Databricks
Architect solutions for ingestion, transformation, storage and serving layers
Collaborate with stakeholders (operations, finance, safety, etc.) to understand business needs
Define and enforce data governance, data quality, metadata management, security, access controls
Work with cloud infrastructure (Azure) to provision, monitor and optimize data compute, storage, and networking resources
Implement CI/CD, testing, monitoring, alerting for data pipelines
Mentor and coach more junior engineers, define best practices, code reviews, knowledge sharing
Troubleshoot performance issues, data discrepancies, failures; ensure high availability, disaster recovery
Requirements
Deep hands-on experience with Databricks (or similar platforms like Spark on cloud)
Strong proficiency in data engineering: building batch & streaming pipelines; ETL/ELT; data modeling
Solid programming skills in Python, Scala or SQL (at least two)
Experience with cloud platforms (ideally Azure), infrastructure as code (Terraform, ARM templates, or similar)
Familiarity with data storage technologies: relational databases, NoSQL, data lakes, Delta Lake / Parquet / parquet-like formats
Understanding of distributed computing, partitioning, scaling, performance tuning
Hands-on experience with data governance, data lineage, data quality frameworks
Experience with CI/CD tooling, version control, automated testing, monitoring and alerting
Senior Solutions Engineer role at Scanner focusing on technical success of deals end - to - end. Involves customer interaction, POCs, and technical demos in a fast - growing environment.
Dynamics 365 Solution Architect designing and implementing solutions for a housing organization. Collaborating with technical and functional consultants to deliver effective systems and services.
Solution Architect designing and delivering enterprise - grade solutions at ID - ware. Collaborating across teams to ensure successful delivery and technical guidance in a hybrid environment.
Senior GenAI Solution Engineer driving AI solutions lifecycle in a consulting firm. Building backend services and automating workflows in an international and agile environment.
Software Engineer for Tektronix developing robust parametric test systems and collaborating with cross - functional teams. Involves testing, debugging, and mentoring junior engineers.
Solutions Architecture Advisor - Integrator collaborating with stakeholders on large - scale projects for clients. Driving impactful solutions in a dynamic and stimulating environment with continuous support.
Solutions Architect II integrating mission critical websites and applications for government organizations. Collaborating closely with customer teams to implement innovative solutions and ensure success.
Delivery Solutions Architect at Databricks providing solutions to customer data challenges and driving growth. Collaborating with technical teams to implement scalable data solutions.
Post - Sales Solutions Engineer driving expansion within existing customers for Anrok's AI - driven tax automation platform. Transforming technical expertise into measurable revenue outcomes while enhancing long - term partnerships.
Vehicle & Systems Integration Engineer developing features to enhance driver experience for Daimler Truck. Collaborating globally to deliver impactful solutions from ideation to implementation.