Data Engineer supporting, developing, and maintaining a data analytics platform with agile delivery. Working with business and IT teams to leverage data technologies effectively.
Responsibilities
Supports, develops and maintains a data and analytics platform.
Effectively and efficiently process, store and make data available to analysts and other consumers.
Works with the Business and IT teams to understand the requirements to best leverage the technologies to enable agile data delivery at scale.
Implements and automates deployment of our distributed system for ingesting and transforming data from various types of sources (relational, event-based, unstructured).
Implements methods to continuously monitor and troubleshoot data quality and data integrity issues.
Implements data governance processes and methods for managing metadata, access, retention to data for internal and external users.
Develops reliable, efficient, scalable and quality data pipelines with monitoring and alert mechanisms that combine a variety of sources using ETL/ELT tools or scripting languages.
Develops physical data models and implements data storage architectures as per design guidelines.
Analyzes complex data elements and systems, data flow, dependencies, and relationships in order to contribute to conceptual physical and logical data models.
Participates in testing and troubleshooting of data pipelines.
Develops and operates large scale data storage and processing solutions using different distributed and cloud based platforms for storing data (e.g. Data Lakes, Hadoop, Hbase, Cassandra, MongoDB, Accumulo, DynamoDB, others).
Requirements
Preferred working experience in technologies like Spark with Databricks and/or Snowflake, PowerBI and deep understanding of conceptual developments in Agentic AI.
Knowledge of SQL (strong)
Python (basic for data handling)
Databricks notebooks (basic transformations)
Understanding of bronze → silver → gold architecture
Familiarity with cloud concepts and technologies in Azure
External candidate must have completed a degree from an accredited US University within the past 2 years.
External candidate must currently reside in the US.
Data Engineer transforming data into actionable insights at InnoWave. Designing data pipelines and collaborating between technical teams and business stakeholders in Lisbon.
Data Engineer developing and maintaining infrastructure for analytics at Waitwhile. Responsible for data lifecycle management, API availability, and AI operationalization.
Data Engineer at Domes Resorts responsible for designing data pipelines and supporting analytics. Join E - Commerce, Intelligence & Innovation team to drive business growth through data solutions.
VP Enterprise Data Architect managing scalable data solutions and architecture for Pacific Life. Leading teams and advancing AI - first data ecosystem.
Senior Data Engineer at Red Hat designing and optimizing 데이터 솔루션 supporting sales and forecasting. Collaborating with teams and applying modern data engineering practices to ensure data quality.
Senior Data Engineer leading the design and implementation of data pipelines for NVIDIA’s analytics and monitoring systems. Collaborating across teams to enhance data ingestion and analysis capabilities.
Associate Data Engineer at Boeing India supporting API Development and Data migration with a focus on engineering and technology solutions. Involves working independently to gather requirements and supporting architecture for API services and data analytics.
Senior Data Engineer building and maintaining robust data pipelines for various data products at Beep Saúde. Collaborating within the team and leading data governance practices.
Software Developer in Test working on cloud - based data platform at Tecsys. Ensuring quality and reliability of data pipelines and transformations using automation frameworks.
Data Engineer responsible for designing, building, and optimizing data pipelines and architectures in a tech environment. Requires extensive experience with modern data warehousing and cloud platforms.