Data Engineer building core data asset at Windfall. Collaborating with multiple teams to design and build data pipelines for large datasets in production.
Responsibilities
Building out the core data asset that everything else at Windfall is built on top of
Work closely with our product, data science, and other engineering teams
Personally design and build the pipelines for massive datasets, taking them all the way from inception to exploration to production and customer use
Requirements
4-8 years of professional data engineering experience
Significant experience working with Apache Beam/Spark/Flink or MapReduce
Strong Object-oriented programming ability in a JVM language
Expert knowledge of distributed data processing
Familiarity with different datastores, their differences, and appropriate usages
Experience at a sub-200 person company
You communicate as well as you code
You can simplify complex problems into simple solutions
You balance a strong sense of ownership and responsibility in your work with collaboration and team alignment
You are comfortable making trade-offs between quality, complexity, and speed-of-delivery
Senior Data Engineer at Keyrus leading the design, development, and delivery of scalable data platforms. Collaborating with teams to translate requirements into production - grade solutions and mentoring engineers.
Senior Data Engineer for global payments platform designing ETL pipelines and data models. Collaborating across teams to tackle complex data challenges in an innovative fintech environment.
Data Warehouse Modelling Engineer designing and maintaining data models using Data Vault 2.0 for iGaming industry. Collaborating with stakeholders and optimizing data models in a hybrid work environment.
Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.