Software Developer in Test working on cloud - based data platform at Tecsys. Ensuring quality and reliability of data pipelines and transformations using automation frameworks.
About the role
- Data Engineer at Boeing optimizing aviation operations through data management and machine learning. Collaborating with engineers to implement data science models while ensuring data integrity.
Responsibilities
- Support data eco-system via data Ingestion and Modelling, Operational Monitoring, Onboarding, Data Health, governance
- Propose data engineering solutions to support different modelling strategies
- Design, build and support healthy, automated, and repeatable data ingestion and processing pipelines
- Raw data ingestion, cleansing, and data contracts
- Design data models and data contracts
- Monitor and maintain data quality, integrity, consistency
- Help design and build scalable, reliable, and high-performance systems and environments
- Effectively contribute to building the overall knowledge and expertise of the technical team
- Participate in work and code reviews with the team
- Take part in implementation and support of continuous integration and continuous delivery (CI/CD)
- Work on systems to monitor system health, data quality and scientific performance
- Implement data access-control for compliance with data governance policies
- Contribute to technical documentation
- Collaborate with developers, data analysts, data scientists and organizational leaders to identify opportunities for process improvements
Requirements
- Minimum 3-year Cloud deployment experience (Azure preferred)
- Minimum 3 years’ experience in relational and non-relational database technologies
- Minimum 3-years’ experience supporting data science and analytics projects and/or infrastructure
- Minimum 3-years building production grade ETL pipelines and Data Mesh and/or Data Bricks
- Must be proficient in Python, SQL, PySpark
- Experience working with Large Language Models (LLM) and Natural Language Processing (NLP) technologies
- Experience working with graph databases, knowledge graphs, and their languages (e.g. GraphQL, Cypher)
Benefits
- Health insurance
- Flexible spending accounts
- Health savings accounts
- Retirement savings plans
- Life and disability insurance programs
- Programs that provide for both paid and unpaid time away from work
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Tech skills
Location requirements
Data Engineer responsible for designing, building, and optimizing data pipelines and architectures in a tech environment. Requires extensive experience with modern data warehousing and cloud platforms.
Lead Data Engineer role at Brillio focusing on AI & Data Engineering with expertise in Azure and MS Fabric. Collaborate within the Data Engineering team in Pune, Maharashtra, India.
Data Architect at Whiteshield designing scalable, secure data architectures for national and enterprise transformation programs. Architecting modern data platforms to support analytics, AI and operational use cases.
Data Engineer managing scalable data ecosystems for actionable business intelligence and cross - functional stakeholder collaboration. Optimizing ETL/ELT pipelines and ensuring data integrity and security.
Data Engineer specializing in data architecture and solutions for a banking environment, driving value for customers through innovative engineering practices and technologies in data management.
Technical Lead for data engineering and reporting in healthcare technology at Dedalus. Shaping innovative software solutions and leading cross - functional technical teams in Australia.
Senior ML Data Engineer working on data pipeline curation for Mobileye's autonomous vehicle dataset. Collaborating across teams to enhance ML engineering and vision model applications.
Data Engineer managing customer datasets to enhance industrial research and development. Responsible for ETL pipelines and data ingestion for the Uncountable Web Platform.
Data Engineer designing and maintaining scalable data solutions on Databricks for clinical trials. Collaborating with teams to overcome data challenges and ensure the smooth logistics of clinical supplies.