Data Engineer deploying Azure Databricks solutions at EY, leading a team and optimizing data models. Collaborating with clients to meet business needs in a cloud environment.
Responsibilities
Develop & deploy Azure Databricks in a cloud environment using Azure Cloud services.
ETL design, development, and deployment to Cloud Service.
Interact with Onshore, understand their business goals, contribute to the delivery of the workstreams.
Design and optimize model codes for faster execution.
Lead and mentor a team of data engineers and analysts, ensuring high-quality delivery and fostering professional growth.
Collaborate with cross-functional teams to manage project timelines and deliverables.
Requirements
9 to 14 years of experience in developing data ingestion, data processing, and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions.
Extensive hands-on experience implementing data migration and data processing using Azure services: Databricks, ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Azure Data Catalog, Cosmos DB, etc.
Familiar with cloud services like Azure.
Hands-on experience on Spark/PySpark.
Hands-on experience in programming languages such as Python/Scala.
Knowledge in DevOps and CI/CD deployments.
Must have hands-on experience in SQL and procedural SQL languages.
Strong analytical skills and enjoys solving complex technical problems.
Proven ability to lead teams, manage resources, and drive projects to successful completion.
Data Solutions Architect leading business intelligence solutions and analytics at Crowe. Overseeing data pipelines and analytics frameworks to drive decision - making and compliance.
Senior Lead Data Engineer designing and building scalable data solutions utilizing AI technology for a globally recognized financial institution. Serving sophisticated clients across the globe.
Data Engineer Consultant building and maintaining enriched data infrastructure for analytical thinking at Northwest Permanente. Involves data collection, cleansing, and transformation for business intelligence.
Vice President - Business, Data Architect role at TD Securities focusing on business data architecture and analytics capabilities. Collaborate with stakeholders to define and govern data models and ensure alignment with strategy.
Staff Data Engineer at Headspace building privacy - first data platforms for mental health support. Leading data engineering strategies and mentoring team members to enhance data - driven decision making.
Senior Data Engineer building and implementing data pipelines at Headspace. Collaborating with analytics and data science teams to enhance personalized mental health support.
Data Engineering Intern working on data pipelines and infrastructure in fast - growing fintech. Collaborating with data engineers, learning best practices and developing data solutions.
Senior Software Engineer building and maintaining data infrastructure for Gusto. Collaborating with Data Science and Business Intelligence teams to achieve their goals.
Data Engineer building and maintaining scalable data pipelines for AI Search Infrastructure at You.com. Collaborating across teams to ensure data quality and enable AI capabilities.
Data Engineer developing and managing technology - based data solutions for clients in different industries in Greece. Participating in software development lifecycle within Agile team setting.