Software Developer in Test working on cloud - based data platform at Tecsys. Ensuring quality and reliability of data pipelines and transformations using automation frameworks.
About the role
- Senior Lead Data Engineer in Bangalore, Karnataka, India designing and building AWS data engineering solutions. Leading teams on scalable data pipelines using Spark, PySpark, and Python.
Responsibilities
- Design, develop, and implement data engineering solutions on AWS cloud
- Build scalable data pipelines using Spark, PySpark, and Python
- Ensure data quality, integrity, and performance optimization across data pipelines
- Collaborate with data architects and business stakeholders
- Provide technical leadership and mentorship to data engineers
Requirements
- Overall 8+ years of experience
- Lead the design, development, and implementation of data engineering solutions on AWS cloud
- Architect and build scalable data pipelines using Spark, PySpark, and Python
- Design and implement data lakes and data warehouse solutions to support analytics and reporting needs
- Develop optimized SQL queries and transformations for large-scale data processing
- Create and maintain data models (dimensional and normalized) to support business intelligence and analytics use cases
- Ensure data quality, integrity, and performance optimization across data pipelines
- Collaborate with data architects, BI teams, and business stakeholders to translate requirements into scalable data solutions
- Provide technical leadership and mentorship to data engineers
- Drive best practices in coding standards, data governance, and performance tuning
- Participate in architecture discussions, design reviews, and project planning
- Ensure timely delivery of data engineering solutions
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer responsible for designing, building, and optimizing data pipelines and architectures in a tech environment. Requires extensive experience with modern data warehousing and cloud platforms.
Lead Data Engineer role at Brillio focusing on AI & Data Engineering with expertise in Azure and MS Fabric. Collaborate within the Data Engineering team in Pune, Maharashtra, India.
Data Architect at Whiteshield designing scalable, secure data architectures for national and enterprise transformation programs. Architecting modern data platforms to support analytics, AI and operational use cases.
Data Engineer managing scalable data ecosystems for actionable business intelligence and cross - functional stakeholder collaboration. Optimizing ETL/ELT pipelines and ensuring data integrity and security.
Data Engineer specializing in data architecture and solutions for a banking environment, driving value for customers through innovative engineering practices and technologies in data management.
Technical Lead for data engineering and reporting in healthcare technology at Dedalus. Shaping innovative software solutions and leading cross - functional technical teams in Australia.
Senior ML Data Engineer working on data pipeline curation for Mobileye's autonomous vehicle dataset. Collaborating across teams to enhance ML engineering and vision model applications.
Data Engineer managing customer datasets to enhance industrial research and development. Responsible for ETL pipelines and data ingestion for the Uncountable Web Platform.
Data Engineer designing and maintaining scalable data solutions on Databricks for clinical trials. Collaborating with teams to overcome data challenges and ensure the smooth logistics of clinical supplies.