Lead Data Engineer architecting enterprise data platform at Ness Digital Engineering. Drive data engineering roadmap and ensure scalability, performance, and innovation.
Responsibilities
Lead the data architecture and engineering strategy, ensuring alignment with business and technology roadmaps.
Design and implement data models, pipelines, and data integration frameworks across multiple platforms.
Partner with stakeholders to translate business requirements into scalable data solutions.
Optimize data pipelines for performance, scalability, and reliability, including query tuning and resource management within Snowflake.
Drive adoption of best practices in data engineering design patterns and modern cloud architectures.
Implement and monitor data validation procedures to ensure data accuracy and consistency across systems.
Work closely with project managers, data architects, and business analysts to align project milestones and deliverables with business goals.
Mentor and guide data engineering teams (onsite & offshore) to deliver high-quality outcomes.
Ensure compliance with data governance, security, and privacy standards.
Create and maintain detailed documentation of data pipelines, data flow diagrams, and transformation logic.
Troubleshoot and resolve issues related to data pipelines, including job failures and performance bottlenecks.
Requirements
Bachelor’s degree in Computer Science, Information Technology, or a related field.
8+ years of experience in data engineering with a strong focus on Data Architecture, Data Modelling (Conceptual, Logical, Physical), ELT processes and data pipeline development.
Hands-on experience with Snowflake cloud data platform, including data sharing, secure views, and performance optimization.
Proficiency in SQL and familiarity with data integration and ETL/ELT tools.
Azure Data Services and other Cloud Technologies (Glue, EMR)
Data Bricks hands on experience
Python for data engineering workflows
Strong understanding of data engineering design patterns
Strong problem-solving skills and the ability to work independently to meet deadlines.
Excellent communication skills for effectively interacting with technical and non-technical stakeholders.
Senior Data Engineer focusing on data infrastructure for an AI - driven insurtech startup based in Nepal. Collaborating with teams to optimize data models and maintain data quality.
Senior Professional Consultant leading architecture and design for SAP BW and SAC solutions at Freudenberg. Collaborating with stakeholders and optimizing performance of data landscapes.
Senior Data Engineer designing and managing data architectures to transform large - scale data into insights for Humana. Involves leading technical discussions and implementing best data practices.
Data Engineer II at Early Warning Services developing data science tools and infrastructure. Collaborating on software enhancements and mentoring interns in a hybrid work environment.
Senior Data Architect responsible for optimizing data architecture and supporting data - driven business decisions at TruStage. Leading technical guidance for data architecture and cross - functional team collaboration.
Senior Data Architect developing data architecture plans at The Hartford, collaborating with internal teams to align data standards and practices. Leading complex solutions with a focus on operational effectiveness.
Senior Solution Architect defining architecture framework for SA‑CCR in regulatory risk. Collaborating with stakeholders to ensure compliance and efficient data governance.
Senior Data Engineer optimizing and designing data pipelines on AWS for The Rec Hub. Collaborating with the team to enhance data processing and mentorship.
Data Engineer at TeCreation focusing on data analysis and innovative system development in the well - being industry. Collaborating on data integration and business intelligence reporting.