Lead Data Engineer role at Brillio focusing on AI & Data Engineering with expertise in Azure and MS Fabric. Collaborate within the Data Engineering team in Pune, Maharashtra, India.
About the role
- AI Data Engineer at Convatec designing and deploying data and AI workflows. Collaborating with AI Engineers and Data Scientists to maintain data pipelines and support analytics.
Responsibilities
- Design, build, and maintain data pipelines using Azure Data Factory, Microsoft Fabric, and Synapse to support AI and analytics workloads.
- Prepare and transform data for AI model training, inference, and retrieval workflows.
- Implement and maintain Lakehouse data models (Delta/Parquet) following Medallion architecture principles.
- Collaborate with AI Engineers to ensure seamless data flow between enterprise systems, APIs, and AI models.
- Develop and test data interfaces and lightweight microservices connecting AI models to business processes.
- Support deployment, monitoring, and performance optimization of AI and automation workflows in production environments.
- Contribute to the setup and maintenance of retrieval-augmented generation (RAG) pipelines and agent-based automation frameworks.
- Use Git and Azure DevOps for version control, CI/CD automation, and deployment of data and AI assets.
- Contribute to Infrastructure-as-Code (IaC) practices using Bicep or Terraform for repeatable deployments.
- Support data and AI governance by documenting processes, lineage, and configuration details to ensure compliance and reusability.
- Translate stakeholder and project requirements into robust, scalable data and AI components.
- Stay current with emerging technologies in AI agents, automation, and data platforms.
Requirements
- 3–6 years’ experience in data engineering, applied AI, or related technical roles.
- Proficiency with Azure Data Factory, Microsoft Fabric, or Synapse Analytics.
- Strong programming skills in Python and SQL for data manipulation and API interaction.
- Understanding of Lakehouse and Medallion architectures, including Parquet, Delta, and JSON data formats.
- Familiarity with Azure AI Services, including Azure ML, Azure OpenAI, and Cognitive Services.
- Experience using Git and Azure DevOps for source control and workflow automation.
- Strong analytical, debugging, and problem-solving abilities with attention to detail.
Benefits
- Flexible working 1 day per week in the office driven by business requirements as Convatec has a flexible approach to office working
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Architect at Whiteshield designing scalable, secure data architectures for national and enterprise transformation programs. Architecting modern data platforms to support analytics, AI and operational use cases.
Data Engineer managing scalable data ecosystems for actionable business intelligence and cross - functional stakeholder collaboration. Optimizing ETL/ELT pipelines and ensuring data integrity and security.
Data Engineer specializing in data architecture and solutions for a banking environment, driving value for customers through innovative engineering practices and technologies in data management.
Technical Lead for data engineering and reporting in healthcare technology at Dedalus. Shaping innovative software solutions and leading cross - functional technical teams in Australia.
Senior ML Data Engineer working on data pipeline curation for Mobileye's autonomous vehicle dataset. Collaborating across teams to enhance ML engineering and vision model applications.
Data Engineer managing customer datasets to enhance industrial research and development. Responsible for ETL pipelines and data ingestion for the Uncountable Web Platform.
Data Engineer designing and maintaining scalable data solutions on Databricks for clinical trials. Collaborating with teams to overcome data challenges and ensure the smooth logistics of clinical supplies.
Senior Manager leading a team of database engineers to manage CCC's data platform. Overseeing mission - critical applications and collaborating with cross - functional teams in a hybrid environment.
As a Principal Data Architect at Solstice, lead the design and implementation of data architecture solutions. Ensure data integrity, security, and accessibility to meet strategic organizational goals.