Senior Data Engineer responsible for designing and implementing data solutions at Harambee. Collaborating with various stakeholders to enhance technology supporting work - seekers' journeys.
About the role
- Data Engineer creating leading cloud platform with big data technologies at SS&C. Building models, managing data migrations, and implementing ETL processes for analytics and automation.
Responsibilities
- Join a team that creates a leading cloud platform with the latest big data, cloud-native and machine learning technologies
- Build and implement models in a production environment for a revenue-driving product
- Create and maintain overall optimal data infrastructure
- Assemble large, complex data sets that meet functional / non-functional business requirements
- Manage data migrations/conversions and troubleshoot data processing issues
- Create the pipeline for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources
- Build machine learning functions to help with data automation and data preparation
- Work closely with our product team and data warehouse engineers to build analytics tools and dashboards that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics
- Work with other data experts to strive for greater functionality in our data systems
- Discover more innovative machine-learning solutions that can drive business values.
Requirements
- Bachelor’s Degree in Computer Science, Information Systems or other STEM field
- 5+ years of experience in data engineering or a related field required
- Proficient coding skills and strong algorithm & data structure basis
- Knowledge of one or multiple of the tools: Hadoop, Spark, Presto, Hive, Kafka, or Airflow
- Skills in transforming data, developing data structures, building a metadata store, and setting up data pipelines or data workflows
- Experience in getting data through API with Python or other programming languages such as JavaScript, Java, C#, Scala, etc
- Strong problem-solving skills with a can-do attitude
- Great software engineering best practices with git and version control systems
- Solid communication skills to explain complex data pipelines to both technical and non-technical people
- Excellent writing and documenting skills
- Self-starter and self-motivated.
Benefits
- 401k Matching Program
- Professional Development Reimbursement
- Flexible Personal/Vacation Time Off
- Sick Leave
- Paid Holidays
- Medical, Dental, Vision
- Employee Assistance Program
- Parental Leave
- Discounts on fitness clubs, travel and more!
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Senior Manager Data Engineer at Squarcle delivering technical leadership in data engineering and compliance with business objectives. Leading teams to optimize and develop data platforms for clients.
Senior Consultant Data Engineer in a consultancy firm focusing on data engineering and platform development. Collaborating with diverse teams to deliver high - quality data solutions.
Data Engineer at Mobileye building robust data pipelines for data infrastructure. Collaborating with teams to deliver high - quality data solutions for dynamic environments.
Cloud Data Engineer at Shift, focusing on building and operating data pipelines on Azure for Australian SMEs. Collaborating across teams to enhance data integration and quality.
AI Systems & Data Engineer at HyperFi designing Databricks pipelines and managing AI systems. Collaborating on data engineering tasks and optimizing workflows in a flexible tech environment.
Engenheiro de Dados especializado em PowerBI e Lakehouse no Campos Thomaz Advogados. Foco em preparar dados para dashboards e estruturação de ambientes com Microsoft.
Data Platform Expert developing and maintaining data solutions for analysis and reporting at Magna Electronics. Collaborating with various teams to enhance data - driven decision making and insights.
Data Engineer at Mobiz designing, building, and maintaining scalable data solutions for analytics. Collaborating with teams to leverage modern cloud technologies and improve data - driven decision - making.
Head of Data Engineering at Envitia overseeing data architecture services for public sector programs. Leading service mobilization with client stakeholders in a hybrid work environment.