Lead Data Engineer role at Brillio focusing on AI & Data Engineering with expertise in Azure and MS Fabric. Collaborate within the Data Engineering team in Pune, Maharashtra, India.
ED
Hybrid Senior Data Engineer – Enterprise Data Warehouse, Lakehouse Solutions
Posted 5 months ago
About the role
- Senior Data Engineer developing Enterprise Data Warehouse & Lakehouse solutions for major clients while working in a hybrid environment in Belgium. Focusing on data engineering and business intelligence solutions.
Responsibilities
- Development and maintenance on Enterprise Data Warehouses (EDW) and complex Business Intelligence Solutions (Data Lakes / Data Lakehouses);
- Design and development of data pipelines for scalable and reliable data workflows to transform extensive quantities of both structured and unstructured data;
- Data integration from various sources, including relational databases, APIs, data streaming services and cloud data platforms;
- Optimisation of queries and workflows for increased performance and enhanced efficiency;
- Writing modular, testable and production-grade code;
- Ensuring data quality through monitoring, validation and data quality checks, maintaining accuracy and consistency across the data platform;
- Elaboration of test programs;
- Document processes comprehensively to ensure seamless data pipeline management and troubleshooting;
- Assistance with deployment and configuration of the system.
Requirements
- University degree in IT combined with relevant IT professional experience of 13 years;
- At least 5 years of experience in relational database systems applied to data warehouse, data warehouse design & architecture;
- At least 5 years of experience in code-based data transformation tools such as Data build tool (dbt), Spark;
- At least 5 years of experience in SQL and data integration and ETL/ELT tools;
- Hands-on experience as Data Engineer in a modern data platform and on data analytics techniques and tools;
- At least 3 years of experience in Python and orchestration tools such as Airflow, Dagster;
- At least 3 years of experience in data modelling tools as well as online analytical data processing (OLAP) and data mining tools;
- Experience with data platforms such as Fabric, Talend, Databricks and Snowflake;
- Experience with containerised application development and deployment tools, such as Docker, Podman, Kubernetes;
- Excellent command of the English language.
Benefits
- If you are seeking a career in an exciting and dynamic company, where you will offer your services as part of a team of a major European Institution, operating in an international, multilingual and multicultural environment where you can expect real chances to make a difference, please send us your detailed CV in English, quoting reference: **(19223/10/25).**
- We offer a competitive remuneration (either on contract basis or remuneration with full benefits package), based on qualifications and experience. All applications will be treated as confidential.
- You may also consider all our other open vacancies by visiting the career section of our web site (www.eurodyn.com) and follow us on Twitter (@EURODYN_Careers) and LinkedIn.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Architect at Whiteshield designing scalable, secure data architectures for national and enterprise transformation programs. Architecting modern data platforms to support analytics, AI and operational use cases.
Data Engineer managing scalable data ecosystems for actionable business intelligence and cross - functional stakeholder collaboration. Optimizing ETL/ELT pipelines and ensuring data integrity and security.
Data Engineer specializing in data architecture and solutions for a banking environment, driving value for customers through innovative engineering practices and technologies in data management.
Technical Lead for data engineering and reporting in healthcare technology at Dedalus. Shaping innovative software solutions and leading cross - functional technical teams in Australia.
Senior ML Data Engineer working on data pipeline curation for Mobileye's autonomous vehicle dataset. Collaborating across teams to enhance ML engineering and vision model applications.
Data Engineer managing customer datasets to enhance industrial research and development. Responsible for ETL pipelines and data ingestion for the Uncountable Web Platform.
Data Engineer designing and maintaining scalable data solutions on Databricks for clinical trials. Collaborating with teams to overcome data challenges and ensure the smooth logistics of clinical supplies.
Senior Manager leading a team of database engineers to manage CCC's data platform. Overseeing mission - critical applications and collaborating with cross - functional teams in a hybrid environment.
As a Principal Data Architect at Solstice, lead the design and implementation of data architecture solutions. Ensure data integrity, security, and accessibility to meet strategic organizational goals.