Senior Data Engineer working on GCP cloud data solutions and ETL processes in AI & Data Engineering team. Collaborating within a hybrid work setup in Bangalore, India.
Responsibilities
Work on data pipeline construction and management
Collaborate with AI & data engineering teams
Perform ETL processes and data transformations
Design and optimize data models and architecture
Ensure data quality and integrity in solutions
Requirements
4+ years of experience in the data engineering field is preferred
3+ years of Hands-on experience in GCP cloud data implementation suite such as Big Query, Pub Sub, Data Flow/Apache Beam, Airflow/Composer, Cloud Storage
Strong experience and understanding of very large-scale data architecture, solutioning, and operationalization of data warehouses, data lakes, and analytics platforms.
Hands on Strong Experience in the below technology o 1. GBQ Query o 2. Python o 3. Apache Airflow o 4. SQL (BigQuery preferred)
Extensive hands-on experience working with data using SQL and Python
Cloud Functions. Comparable skills in AWS and other cloud Big Data Engineering space is considered.
Experience with agile development methodologies
Excellent verbal and written communications skills with the ability to clearly present ideas, concepts, and solutions
Bachelor's Degree in Computer Science, Information Technology, or closely related discipline
Technical Lead for data engineering and reporting in healthcare technology at Dedalus. Shaping innovative software solutions and leading cross - functional technical teams in Australia.
Senior ML Data Engineer working on data pipeline curation for Mobileye's autonomous vehicle dataset. Collaborating across teams to enhance ML engineering and vision model applications.
Data Engineer managing customer datasets to enhance industrial research and development. Responsible for ETL pipelines and data ingestion for the Uncountable Web Platform.
Data Engineer designing and maintaining scalable data solutions on Databricks for clinical trials. Collaborating with teams to overcome data challenges and ensure the smooth logistics of clinical supplies.
Senior Manager leading a team of database engineers to manage CCC's data platform. Overseeing mission - critical applications and collaborating with cross - functional teams in a hybrid environment.
As a Principal Data Architect at Solstice, lead the design and implementation of data architecture solutions. Ensure data integrity, security, and accessibility to meet strategic organizational goals.
Data Platform Specialist overseeing data workflows and enhancing data quality for Stackgini's AI - driven IT solutions. Collaborating with teams to drive improvements and stakeholder support.
Data Engineer designing data pipelines in Python for a major railway industry client. Collaborate with Data Scientists and ensure code quality with agile methodologies.
Senior Data Engineer responsible for building and optimizing data pipelines for banking analytics initiatives. Collaborating with data teams to ensure data quality and readiness for enterprise use.
Senior Data Engineer developing scalable data solutions on Databricks for analytics and operational workloads. Collaborating with cross - functional teams to modernize the data ecosystem.