Senior Data Engineer designing and optimizing data platforms for clients using Microsoft Azure, Microsoft Fabric, Power BI, and Databricks. Working closely with clients to deliver scalable solutions.
Responsibilities
Work directly with clients to understand business goals, data challenges, and technical requirements
Lead or support discovery sessions, requirements workshops, architecture discussions, and solution reviews
Develop and optimize batch and streaming data ingestion pipelines from enterprise applications, databases, APIs, and file-based sources
Implement medallion/Lakehouse architectures, dimensional models, and data transformation workflows to support analytics and reporting use cases
Engineer solutions using technologies such as PySpark, Spark SQL, SQL, Python, Delta Lake, and orchestration tools within Azure and Databricks
Recommend best practices for data modeling, governance, lineage, monitoring, DevOps, and security
Help establish engineering standards, reusable frameworks, accelerators, and documentation for internal and client teams
Contribute to estimation, project planning, and delivery management for client engagements
Requirements
Bachelor’s degree in computer science or related field
8 years of experience in data engineering, data platform development, or cloud data solutions
3 years of hands-on experience with Azure Databricks, Apache Spark, or similar distributed data processing technologies
Expertise with Microsoft Azure infrastructure and data resources, including Fabric, Azure Data Factory, Synapse Data Analytics, Power BI, Azure SQL, Azure Cosmos DB
Deep expertise with Databricks, specifically the ability to design enterprise-level strategy and architecture including Unity Catalog, data warehousing, data sharing, and Mosaic AI
Experience setting end-to-end modern data platforms in Azure including architecture/design, ingestion, storage strategies, analytics & reporting, Apache Spark, and networking requirements
DevOps for data, GitHub, automated testing, and working with containers (AKS, Docker, registries, etc.)
Excellent communication skills, ability to clearly explain concepts to teammates and customers, and quickly learn new concepts and technologies.
Data Solutions Architect leading business intelligence solutions and analytics at Crowe. Overseeing data pipelines and analytics frameworks to drive decision - making and compliance.
Senior Lead Data Engineer designing and building scalable data solutions utilizing AI technology for a globally recognized financial institution. Serving sophisticated clients across the globe.
Data Engineer Consultant building and maintaining enriched data infrastructure for analytical thinking at Northwest Permanente. Involves data collection, cleansing, and transformation for business intelligence.
Vice President - Business, Data Architect role at TD Securities focusing on business data architecture and analytics capabilities. Collaborate with stakeholders to define and govern data models and ensure alignment with strategy.
Staff Data Engineer at Headspace building privacy - first data platforms for mental health support. Leading data engineering strategies and mentoring team members to enhance data - driven decision making.
Senior Data Engineer building and implementing data pipelines at Headspace. Collaborating with analytics and data science teams to enhance personalized mental health support.
Data Engineering Intern working on data pipelines and infrastructure in fast - growing fintech. Collaborating with data engineers, learning best practices and developing data solutions.
Senior Software Engineer building and maintaining data infrastructure for Gusto. Collaborating with Data Science and Business Intelligence teams to achieve their goals.
Data Engineer building and maintaining scalable data pipelines for AI Search Infrastructure at You.com. Collaborating across teams to ensure data quality and enable AI capabilities.
Data Engineer developing and managing technology - based data solutions for clients in different industries in Greece. Participating in software development lifecycle within Agile team setting.