Lead Engineer providing technical expertise in electrification solutions for EHV/HV substations at GE Vernova. Responsible for system design, material selection, and project consultations.
About the role
- Senior Data Tech Lead/Architect designing and implementing AWS-based streaming data pipelines. Collaborating with teams to improve data quality and reconciliation workflows in a high-impact data platform.
Responsibilities
- Provide technical solution discovery effort on any new capabilities or new functionality.
- Assist PO with technical user stories to ensure healthy backlog features
- Lead the development of **real-time data pipelines** using **AWS DMS**, **MSK**, Kafka or Glue Streaming and for CDC ingestion from multiple SQL Server sources (RDS/on-prem).
- Build and optimize **streaming and batch data pipelines** using **AWS Glue (PySpark)** to validate, transform, and normalize data to **Iceberg and DynamoDB**.
- Define and enforce **data quality, lineage, and reconciliation logic** with support for both streaming and batch use cases.
- Integrate with **S3 Bronze/Silver layers** and implement efficient **schema evolution and partitioning strategies** using Iceberg.
- Collaborate with architects, analysts, and downstream application teams to design **API and file-based egress** layers.
- Implement **monitoring, logging**, and **event-based alerting** using CloudWatch, SNS, and EventBridge.
- Mentor junior developers and enforce best practices for modular, secure, and scalable data pipeline development.
Requirements
- 6+ years of hands-on expert level data engineering experience in **cloud-based environments** (AWS preferred) with event driven implementation
- Strong experience with **Apache Kafka / AWS MSK** including topic design, partitioning, and Kafka Connect/Debezium
- Proficiency in **AWS Glue (PySpark)** and for both batch and streaming ETL
- Working knowledge of **AWS DMS**, **S3**, **Lake Formation**, **DynamoDB**, and **Iceberg**
- Solid grasp of **schema evolution**, **CDC patterns**, and **data reconciliation frameworks**
- Experience with infrastructure-as-code (CDK/Terraform) and DevOps practices (CI/CD, Git)
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Embedded Software Engineer developing and testing embedded software for AV products at Audinate. Collaborating with cross - functional teams to enhance and introduce new features utilizing leading network technology.
Full Stack Developer building AI driven software for real estate industry at Rex Cirrus8. Designing scalable systems and collaborating with teams while leveraging AI tools.
Senior Full Stack Engineer responsible for developing and integrating AI tools in a HealthTech startup, providing impactful solutions for therapists' workflows.
Full Stack Engineer developing AI systems for a proactive chat app. Building features across frontend, backend, and AI integrations for reliable workflows.
Full - Stack Developer creating innovative digital solutions at Dreamlight Labs. Develop modern web interfaces and APIs while collaborating with a dynamic team in the creative industry.
Software Tech Lead responsible for Full Stack architecture and development at SPiNE Energy startup. Engage in innovative energy applications and scalable solutions for energy management.
Product Engineer responsible for full - stack development and feature ownership using AI tools. Join JustDice in Hamburg to build mobile and apps in a supportive environment.
Senior Staff Engineer at mylo responsible for large - scale technical impact across backend systems. Collaborating with teams to ensure architectural excellence and improve system reliability.
Full Stack Developer at Centah managing integrations and API features for a scalable SaaS platform. Contributing to system reliability and mentoring less experienced engineers.