Data Engineer role for Alberta Securities Commission, focusing on data pipelines and infrastructure. Involves designing, building, and securing data assets for organizational decision-making.
Responsibilities
Designing, building, and maintaining the data pipelines and infrastructure supporting data-driven initiatives
Ensuring data is accessible, reliable, and secure
Enabling data-driven decision-making across the ASC
Developing efficient and scalable data pipelines to ingest/extract, transform, and load data
Identifying and addressing performance bottlenecks in data pipelines and queries
Monitoring data quality and implementing improvements
Assisting stakeholders with data-related technical issues
Developing and maintaining documentation related to data pipeline architecture, development processes and data governance standards
Staying current with industry trends and developments in cloud computing, data management and AI
Using DevOps Continuous Integration and Delivery (CI/CD) processes
Providing hands-on data integration support as part of daily operations
Collaborating closely with the Data Architect to design and construct a highly scalable data management platform
Working closely with cybersecurity team to establish access control in analytics solutions
Requirements
A college diploma or university degree in computer science, information systems, or computer engineering
A minimum of 8 years of proven experience in a Data Engineer role
Azure or other cloud certification (e.g. Fabric Data Engineer)
Other data- or security-related certifications would be considered assets
Strong knowledge of applicable data privacy practices and regulations
Hands-on experience with cloud services, particularly Microsoft Fabric
Strong programming and query language skills in Python, SQL, KQL
Familiarity with federated data governance and self-serve data platforms
Excellent communication skills, with the ability to translate non-technical requirements into technical solutions
Strong organizational skills including attention to detail and multitasking skills
A results-oriented and deadline-driven approach
The ability to multi-task, set priorities, coordinate and schedule
Excellent critical thinking, analytical and decision-making capabilities
Benefits
100 per cent employer-paid benefits effective your first day of employment
Comprehensive health and dental plan
Flex days
Employee family assistance program
Transportation allowance
Generous flexible spending account
Fun initiatives through ASC Social Club and annual United Way Campaign
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.
Data Engineer (dbt) at SDG Group involved in all phases of data projects. Collaborate on data ingestion, transformation, and visualization in a hybrid environment.
Data Consultant at SDG Group specializing in Data & Analytics projects. Collaborate on technical - functional definitions, ETL, data modeling, and visualization for cloud solutions.
Senior Data Engineer responsible for growing customer - defined targeting calculations and developing key/value databases for real - time data processing.