Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.
About the role
- Senior Data Engineer responsible for growing customer-defined targeting calculations and developing key/value databases for real-time data processing.
Responsibilities
- Working with stakeholders to grow the amount and kinds of customer-defined targetings we can calculate in real-time
- Develop new features for our in-house streaming key/value DBs
- Improve resource utilization across all stages of our data pipelines, from validation and ingestion to storage to dynamic queries
- Collaborate with developers and stakeholders to design services in order to meet product and business requirements
Requirements
- Strong experience designing, building, implementing, and maintaining large real-time data pipelines with Kafka and Kafka Streams
- Significant expertise with data consistency, throughput, and event-driven system concepts
- Fluent in Python and/or Java
- Familiar with designing and deploying data jobs
- Experience with managing and monitoring service infrastructure and deployments
- Worked with Kafka, Kafka Streams, Trino (or any distributed SQL engine), Airflow, Kubernetes, Docker, Helm, Jenkins, Prometheus, Grafana, Elasticsearch
- Nice to have: Basic knowledge of AWS services such as S3 and RDS, and Terraform
Benefits
- A chance to be a part of a casual but professional environment where you will have a safe place to try, fail and learn
- Coaching from our tech leads to advance your soft and technical skills and set your own development path
- Defined and organized the onboarding process for both, the company and the project
- Competitive compensation depending on experience and skills
- Private pension and medical insurance for you and your family. Also, maternity and sick leave are 100% paid
- Sport clubs – from fishing to basketball, whatever rocks your boat
- Awesome referral fees - because great people know great people
- Work-life balance – this is the company that really supports your professional, family and personal goals
- Freedom to decide how you want to work - partly or fully remote or from our offices
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer (dbt) at SDG Group involved in all phases of data projects. Collaborate on data ingestion, transformation, and visualization in a hybrid environment.
Data Consultant at SDG Group specializing in Data & Analytics projects. Collaborate on technical - functional definitions, ETL, data modeling, and visualization for cloud solutions.
Data Engineer developing and maintaining the Data Lakehouse platform using Microsoft Azure technology stack at RBC. Collaborating with business and technology teams to enhance data ingestion and modeling processes.
Data Engineer focused on creating a data platform for automated cyber insurance. Collaborating with stakeholders to deliver data processing capabilities and governance.
Data Engineer building and maintaining data platform solutions for clients at Dignify. Designing, developing, and optimising data models and pipelines with a focus on Google BigQuery.
Data Engineer designing and developing data solutions using AI and machine learning for marketing applications. Collaborating in teams to create impactful data - driven solutions for clients across various industries.
Senior Data Engineer developing scalable data solutions for electric vehicle market at Kempower. Collaborating with cross - functional teams to enhance data engineering processes.
Data Engineer responsible for developing research analytic data infrastructure at Sutter Health. Involves managing data quality, pipelines, and compliance with healthcare regulations.
Senior Data Engineer designing impactful data solutions for clients at Simple Machines. Collaborating with engineers to build data platforms and pipelines in a hybrid workplace.