Software Engineer at Warner Music Group developing an innovative Data Platform for the music industry. Collaborating with dynamic teams to enhance music data processing and delivery.
About the role
- Data Engineer at Kyndryl designing and maintaining data pipelines using AWS and Python. Optimizing ingestion, transformation workflows, and cloud solutions for large-scale data environments.
Responsibilities
- designing, developing, and maintaining large‑scale data pipelines using Python, PySpark, and SQL
- building and optimizing data ingestion, transformation, and processing workflows on AWS using services such as Lambda, Glue, EMR, S3, Athena, DynamoDB, Step Functions, MWAA, EventBridge, SNS/SQS, and Kinesis
- implementing secure, scalable, and reliable cloud solutions aligned with AWS best practices through IAM, CloudWatch, CloudTrail, and Secrets Manager
- working extensively with modern table formats like Apache Iceberg, Delta Lake, or Apache Hudi
- developing and tuning advanced SQL queries, including Teradata SQL
- contributing to scalable, reliable, and cost‑efficient Data Lake and Lakehouse architectures
- designing event‑driven and serverless data solutions, including real‑time streaming pipelines
- applying strong data modeling principles such as partitioning strategies, schema evolution handling, and metadata management
- building and maintaining CI/CD pipelines using GitLab or Jenkins
- automating infrastructure provisioning with Terraform
- ensuring code quality through unit testing, code reviews, and adherence to engineering best practices
Requirements
- 8+ years of strong hands‑on experience in Python, SQL, and PySpark
- Solid understanding of distributed data processing frameworks and cloud‑native architectures
- Proven experience working within the AWS data ecosystem
- Experience delivering solutions in large‑scale, fast‑paced environments with a strong focus on automation and data quality
- Good working knowledge of Data Warehousing (DWH) concepts
- Data Lakes / Lakehouse architectures
- Ability to design and support production‑grade data pipelines end‑to‑end
- Basic hands‑on experience with Terraform and CI/CD pipelines
- Familiarity with Delta Lake / Iceberg / Hudi
- Exposure to real‑time streaming architectures
- AWS Data Engineer or Advanced‑level AWS certifications (preferred)
Benefits
- flexible, supportive environment
- well-being prioritized
- personalized development goals aligned with your ambitions
- access to cutting-edge learning opportunities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer role specializing in Azure & Snowflake at InfoCentric. Leading design and delivery of enterprise - scale data platforms for large organizations.
Principal Data Architect at PointClickCare ensuring coherent and scalable data architecture. Driving unified data direction while collaborating with Engineering Architecture team for AI enablement.
Data Engineer Tech Lead developing data solutions at Carelon. Leading a cross - functional team to optimize data workflows and maintain data integrity.
Lead Data Engineer responsible for evolving Manna’s data infrastructure for drone delivery. Overseeing data architecture and analytics while building scalable data pipelines.
Data Engineer designing, implementing, and optimizing data pipelines for DeepLight AI. Collaborating closely with a multidisciplinary team to analyze large - scale data.
Data Engineer designing and maintaining scalable ETL pipelines at Satori Analytics. Collaborating with teams to deliver high - quality analytics solutions across various industries.
Data Architect responsible for defining enterprise data architecture on AWS and Databricks Lakehouse platforms. Enabling scalable data lakes and enterprise analytics for financial services organizations.
Data Platform Operations Support leading data engineering strategy across projects for EXL. Driving innovation and optimization while collaborating with various teams in the organization.
Manager II leading data engineering projects at Navy Federal Credit Union. Overseeing data governance and quality initiatives while managing engineering teams in a hybrid work environment.