Engineer specializing in building automation in hybrid work environment at sic architekten gmbh. Contributing to sustainable and functional building projects in Köln.
About the role
- Engenheiro(a) de Dados responsável por desenvolvimento de pipelines e otimização de dados em Azure. Focando na qualidade de dados e na arquitetura Medallion.
Responsibilities
- Pipeline Development: Build and maintain robust data pipelines using PySpark in the Azure Databricks environment, ensuring high availability and continuous data flow.
- Medallion Architecture: Implement and manage the data lifecycle following a layered structure (Bronze, Silver, Gold), ensuring organization and quality from ingestion through consumption.
- Ingestion and Integration: Configure ETL/ELT workflows from heterogeneous sources (SQL Server, APIs, streaming) using Azure Data Factory and Azure Data Lake Storage (ADLS).
- Optimization and Monitoring: Oversee cluster and process performance with a focus on scalability, latency reduction, and cost-efficiency in the cloud.
- Data Quality: Develop data cleansing, processing and enrichment routines to turn raw data into assets ready for business analysis.
- Security and Governance: Document technical processes and ensure all pipelines comply with data security and privacy policies.
Requirements
- Education: Bachelor's degree in Computer Science, Engineering, Data Science or related IT fields.
- Azure Cloud: Hands-on experience with the Microsoft data ecosystem.
- Technical Stack: Advanced proficiency in Databricks, PySpark, Python and SQL.
- Architecture: Solid experience with Medallion Architecture, Data Lake concepts and Delta Lake technology.
- Modeling: Knowledge of data modeling (Dimensional/Star schema).
- Visualization: Basic knowledge of Power BI to support the consumption (Gold) layer.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
EHS and Quality Engineer responsible for compliance with Primetals Quality and EHS programs. Joining a leading partner in engineering and lifecycle services for the metal industry.
Project Engineer managing technically demanding national and international large - scale projects. Involvement from first inquiry to execution with a global presence in construction technology.
Dual Fuel Smart Meter Engineer responsible for installing smart meters in domestic properties at Utilita. Championing customer experience and collaborating with technical support teams.
Dual Fuel Smart Meter Engineer installing smart meters in domestic properties for Utilita. Championing customer first mindset and industry leading Customer Experience while collaborating with internal teams.
Provide customer support through installation and servicing of linear accelerators at Varian. Involves extensive travel and technical support of imaging systems and equipment.
Jr. NPI Engineer supporting product and process implementation at Establishment Labs, a rapidly growing medical device company. Collaborating across departments to ensure high - quality operations compliance.
Engineer I providing technical engineering support for electrical trades at Rosendin. Assisting in design and consultation under supervision while developing engineering skills and competencies.
Supplier Development Engineer at Ensign - Bickford overseeing supplier quality and delivery metrics. Collaborating with teams to enhance manufacturing processes in aerospace and defense sectors.
Ingeniero/a oficina técnica at KONE understanding client needs and providing technical solutions. Managing documentation, validation processes, and ensuring product compliance with security and environmental standards.