Senior Data Engineer developing scalable data solutions on Databricks for analytics and operational workloads. Collaborating with cross - functional teams to modernize the data ecosystem.
About the role
- Data Engineer (GCP) designing and maintaining scalable data platforms at LUZA Group in Portugal. Collaborating and ensuring data integrity across multiple complex datasets.
Responsibilities
- Design, build, and maintain scalable data platforms.
- Collect, process, and analyze large and complex data sets from various sources.
- Develop and implement data processing workflows using data processing framework technologies such as Spark and Apache Beam.
- Collaborate with cross-functional teams to ensure data accuracy and integrity.
- Ensure data security and privacy through proper implementation of access controls and data encryption.
- Extract data from various sources, including databases, file systems, and APIs.
- Monitor system performance and optimize for high availability and scalability.
Requirements
- Experience with cloud platforms and services for data engineering (GCP).
- Experience with Big Data tools such as Spark, Flink, Kafka, Elastic Search, Hadoop, Hive, Sqoop, Flume, Impala, Kafka Streams and Connect, Druid, etc.
- Experience with relational and NoSQL databases.
- Experience with data integration and ETL tools (e.g., Apache Kafka, Talend).
- Experience with version control tools such as Git.
- Stack Tech: Python, Java, or Scala. Spark, Apache Beam. Flink, Kafka, Elastic Search, Hadoop, Hive, Sqoop, Flume, Impala, Kafka Streams and Connect, Druid. SQL. Relational and NoSQL databases. Cloud platforms (GCP, AWS S3, Azure Data Factory). Git.
- Knowledge of data modeling and database design principles.
- Understanding of distributed systems and data processing architectures.
Benefits
- Our company does not sponsor work visas or work permits.
- All applicants must have the legal right to work in the country where the position is based.
- Only candidates who meet the required qualifications and match the profile requested by our clients will be contacted.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.
Data Engineer delivering AI - and data - driven solutions for Honeywell’s industrial customers. Architecting and implementing scalable data pipelines and platforms focused on IoT and real - time data processing.
Data Engineering Associate focusing on data quality control and management for distribution platform. Collaborates on large scale data projects to ensure data accuracy and availability for users.
Data Architect managing enterprise data platform built on Microsoft Fabric at Johnstone Supply. Leading architectural standards and collaborating with business and IT leaders for strategic data - driven insights.
Data Engineer at Studyportals responsible for data pipelines and infrastructure. Join a team ensuring accurate and trustworthy data for analytics and business decisions.
AI/ML Engineer designing and refining prompts and workflows using large language models. Responsible for developing data pipelines and delivering scalable AI solutions in a hybrid work environment.