Data Engineer Consultant building and maintaining enriched data infrastructure for analytical thinking at Northwest Permanente. Involves data collection, cleansing, and transformation for business intelligence.
About the role
- Data Engineer managing data pipelines and analytics for strategic data projects in corporate environments. Working with data governance, integration, and BI initiatives.
Responsibilities
- Develop and maintain data ingestion, transformation and loading pipelines (ETL/ELT) from multiple sources (APIs, relational databases, files, legacy systems and cloud)
- Work on data modeling (Data Lake, Data Warehouse and Data Marts), ensuring performance, scalability and governance
- Process large volumes of data using Spark (PySpark or Scala) and Big Data frameworks
- Develop scripts and automations in Python for data extraction, integration and processing
- Create and optimize advanced SQL queries (procedures, views, functions, jobs), with a focus on performance
- Work in cloud environments (GCP, Oracle Cloud, Azure or similar), participating in data migration and modernization projects
- Integrate data across different platforms and systems (e.g., CRM, marketing, surveys, corporate systems)
- Support the development of dashboards and reports in Power BI, ensuring reliable data for analysis and decision-making
- Collaborate with business, analytics and technology teams to understand requirements and translate them into data solutions
- Document processes, models and data pipelines, following engineering and governance best practices
Requirements
- Proven experience as a Data Engineer or in similar roles
- Advanced SQL proficiency, including query optimization and database objects
- Strong experience in ETL/ELT using tools such as PowerCenter, Pentaho, Databricks, SSIS or equivalents
- Practical knowledge of Python for data engineering and automation
- Experience with distributed processing (Spark – PySpark or Scala)
- Experience in cloud environments (Google Cloud, Oracle Cloud, Azure or similar)
- Experience with Data Lakes, Data Warehouses and data modeling
- Knowledge of data integration via APIs, files and secure transfer (SFTP)
- Ability to communicate with technical and business stakeholders
Benefits
- Remote work
- Join a high-performance team
- Opportunities for professional development
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Vice President - Business, Data Architect role at TD Securities focusing on business data architecture and analytics capabilities. Collaborate with stakeholders to define and govern data models and ensure alignment with strategy.
Staff Data Engineer at Headspace building privacy - first data platforms for mental health support. Leading data engineering strategies and mentoring team members to enhance data - driven decision making.
Senior Data Engineer building and implementing data pipelines at Headspace. Collaborating with analytics and data science teams to enhance personalized mental health support.
Data Engineering Intern working on data pipelines and infrastructure in fast - growing fintech. Collaborating with data engineers, learning best practices and developing data solutions.
Senior Software Engineer building and maintaining data infrastructure for Gusto. Collaborating with Data Science and Business Intelligence teams to achieve their goals.
Data Engineer building and maintaining scalable data pipelines for AI Search Infrastructure at You.com. Collaborating across teams to ensure data quality and enable AI capabilities.
Data Engineer developing and managing technology - based data solutions for clients in different industries in Greece. Participating in software development lifecycle within Agile team setting.
Data Architect leading design and governance of high - quality data architectures for clients. Collaborating with engineering teams and stakeholders to transform business challenges into scalable data solutions.
Data Engineer supporting vehicle buying and selling solutions through integration pipelines. Collaborating with teams to build digital vehicle platforms and optimize data processes in São Paulo.