Data Platform Expert developing and maintaining data solutions for analysis and reporting at Magna Electronics. Collaborating with various teams to enhance data - driven decision making and insights.
About the role
- Data Engineer Consultant building and maintaining enriched data infrastructure for analytical thinking at Northwest Permanente. Involves data collection, cleansing, and transformation for business intelligence.
Responsibilities
- Develops data warehouse solutions through ingesting, integrating, and curating data, building database solutions, and administering systems to deliver enriched data to business intelligence analysts and data scientists
- Utilizes Spark SQL and Python in Databricks to build and optimize scalable data pipelines
- Assists in efforts to facilitate, analyze, design, and execute architecture solutions and ensure solutions are leveraged; assists in creating documents and communicates the integration approach for components of the solution
- Applies knowledge of ETL design, development, and processes, including building and orchestrating Databricks workflows and using Spark SQL and Python for data transformation
- Takes accountability for ensuring specific interfaces, methods, parameters, procedures, and functions support technical solutions and are aligned with architectural designs
- Assists in efforts to identify and design solutions that allow performing root cause analyses to enable proactive issue resolution and data quality maintenance; assists in efforts to build processes and diagnostics tools/measures into the development process so that data pipelines can be monitored, and issues detected proactively
- Gathers scope and business requirements for data infrastructure projects
- Assists in efforts to translate business requirements and functional specifications into physical program designs, code modules, stable and reliable data solutions by partnering with analysts and other team members to understand business needs and functional specifications
- Assists in efforts to create data dictionaries to document data lineages, data definitions, transformations, and metadata for data infrastructure projects; identifies and reconciles inconsistencies in data definitions; takes steps to assure metadata accuracy and validity
- Documents programming changes and design, system modifications and their associated maintenance
- Assists in executing strategies and plans for data security, backup, recovery, business continuity, and archiving
- Identifies and develop opportunities for data reuse, migration, or retirement
- Reviews and verifies resource estimates for technical design, coding, and testing efforts
- Practices self-leadership and promotes learning in others by soliciting and acting on performance feedback; builds collaborative, cross-functional relationships.
Requirements
- Bachelor’s degree in Computer Information Systems, Computer Science, or related field
- Three (3) years of hands-on Databricks experience (Notebooks, Jobs, Workflows) in ETL design, implementation, and maintenance using technologies using Python, Spark SQL, Delta Lake, GitHub, SFTP, and TCP/IP
- Four (4) years of experience in IT with a broad range of exposure to all aspects of business planning, systems analysis, application development, and/or data warehouse development using SDLC methodologies
- Four (4) years data analytical experience
- Two (2) years of hands-on experience in architecture, data modeling, and implementation of the enterprise data solutions
- Strong passion for data analytics and fostering a data driven culture
- Familiarity with legal, security and regulatory issues associated with managing and exposing sensitive institutional data
- Experience working with relational databases, data extraction and manipulation language, and in architecture principles and techniques across master data, transaction data and derived/analytic data
- Experience in the use of data warehouse ETL methodologies and tools.
Benefits
- 15% employer contribution to retirement programs, including pension
- 90% employer-paid health plan
- Tuition Reimbursement
- Child Care Benefits
- Flexible Work Schedules
- Paid Parental Leave
- Self-Care Days + Paid Time Off
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer at Mobiz designing, building, and maintaining scalable data solutions for analytics. Collaborating with teams to leverage modern cloud technologies and improve data - driven decision - making.
Head of Data Engineering at Envitia overseeing data architecture services for public sector programs. Leading service mobilization with client stakeholders in a hybrid work environment.
Applied AI Health Data Architect - Senior Manager at PwC designing data architecture for healthcare operations. Contributing to innovative data solutions and mentoring teams for operational excellence.
CRM Functional Data Migration Engineer at Data - Core Systems, Inc. managing Dynamics 365 CE solutions and delivering technical expertise in a consulting role.
Data Engineer role for Alberta Securities Commission, focusing on data pipelines and infrastructure. Involves designing, building, and securing data assets for organizational decision - making.
Data Architect supporting UK MOD programme delivering data and integration capabilities for Defence. Join Amentum's growing IT team focused on critical national infrastructure and security projects.
Data Engineer joining Contour Software's development team to handle various big data projects. Focus on cloud data lake architecture and machine learning implementation.
Enterprise Architect Sr position at PNC collaborating with technology stakeholders to build enterprise data architecture. Focus on data models, governance, and guiding data decisions for business strategy.
Data Engineer architecting and maintaining data products using Databricks and Power BI for Nitro's digital transformation efforts. Collaborating to optimize processes and leverage cloud technologies.