Full Stack Data Engineer responsible for building and optimizing data pipelines and lakehouse architectures. Collaborating with teams to ensure data quality and delivering analytics-ready datasets.
Responsibilities
Design, develop, and maintain end-to-end data pipelines using **Python, PySpark, and SQL**
Build and optimize data transformation workflows using **dbt on Snowflake**
Develop scalable **lakehouse architectures** for structured and semi-structured data
Implement reliable data ingestion frameworks using **Kafka, AWS Glue, and custom connectors**
Orchestrate workflows and manage dependencies using **Apache Airflow**
Manage cloud infrastructure on **AWS** (S3, Glue, EMR, Redshift/Snowflake integrations)
Implement Infrastructure as Code (IaC) using **Terraform**
Collaborate with cross-functional teams to deliver analytics-ready datasets
Ensure data quality, performance optimization, and cost efficiency
Use **GitLab** for version control, CI/CD, and collaborative development
Monitor, troubleshoot, and resolve data pipeline issues in production environments
Requirements
4+ years of experience with **AWS** data services and cloud-based data engineering
Strong programming skills in **Python** and **PySpark**
Hands-on experience with **Snowflake** and **dbt** for data modeling and transformations
Solid understanding of **SQL** for complex analytical queries
Experience with **Apache Airflow** for workflow orchestration
Proficiency in **Kafka** for real-time/streaming data ingestion
Experience with **AWS Glue/ Airflow** for ETL development
Experience with **Terraform** for infrastructure automation
Strong experience with **GitLab** and CI/CD pipelines
Data Engineering Intern assisting with data projects and cloud solutions at Simmons Bank. Collaborating on data pipelines and gaining exposure to modern data engineering concepts.
Data Engineer building and scaling client - facing Microsoft Fabric analytics platform to drive revenue and decision - making. Collaborating with teams to develop pipelines, optimize performance, and ensure client satisfaction.
Data Engineer role focusing on migrating legacy systems to ADA at BBVA. Collaborate with multidisciplinary teams and ensure system integrity during transitions.
Senior Data Engineer focused on modernizing enterprise data capabilities at U.S. Bank. Designing and building reusable data engineering patterns for consistent delivery across teams.
Senior Data Engineer at SS&C building and optimizing data pipelines in a lakehouse environment. Collaborating with data architects and stakeholders in the financial services sector.
Principal Data Pipeline Lead at SS&C overseeing development of scalable data pipelines. Leading a small team and providing technical guidance for modern data platform integration.
Experienced Data Architect designing and implementing scalable data architecture for a financial services and healthcare technology company. Collaborating across teams to support analytics and operational needs.
Data Architect designing scalable, secure data architectures for fraud detection and risk management at Fiserv. Collaborating with cross - functional teams and managing large datasets and pipelines.
Director of Engineering overseeing development of AI - driven data platforms at LVT. Leading teams to transform sensor data into actionable insights using modern architecture and technologies.
Senior Data Engineer at Independence Pet Holdings shaping data ecosystem by building platforms and pipelines. Collaborating with teams to enhance data analytics and operational insights.