Data Engineer working on ingesting, transforming, and analyzing data on Google Cloud Platform. Collaborating with cross-functional teams in Chennai to deliver analytical data products.
Responsibilities
Work on a Central Engineering Portfolio Team based in Chennai to deliver curated data products and perform end to end Full stack Data engineer role.
Work effectively with fellow data engineers, product owners, data champions and other technical experts.
Demonstrate technical knowledge and communication skills with the ability to advocate for well-designed solutions.
Develop exceptional analytical data products using both streaming and batch ingestion patterns on Google Cloud Platform with solid data warehouse principles.
Be the Subject Matter Expert in Data Engineering with a focus on GCP native services and other well integrated third-party technologies.
Requirements
5+ years of SQL development and analytics/data product development experience.
3+ years of cloud experience (GCP preferred) with solutions designed and implemented at production scale.
Experience working in GCP native (or equivalent) services like Big Query, Google Cloud Storage, PubSub, Dataflow, Dataproc, Cloud Build, etc.
Experience working with Airflow for scheduling and orchestration of data pipelines.
Experience working with Terraform to provision Infrastructure as Code.
2 + years professional development experience in Java or Python.
Bachelor’s degree in computer science or related scientific field.
Experience in analyzing complex data, organizing raw data, and integrating massive datasets from multiple data sources to build analytical domains and reusable data products.
Senior Data Engineer at Keyrus leading the design, development, and delivery of scalable data platforms. Collaborating with teams to translate requirements into production - grade solutions and mentoring engineers.
Senior Data Engineer for global payments platform designing ETL pipelines and data models. Collaborating across teams to tackle complex data challenges in an innovative fintech environment.
Data Warehouse Modelling Engineer designing and maintaining data models using Data Vault 2.0 for iGaming industry. Collaborating with stakeholders and optimizing data models in a hybrid work environment.
Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.