Platform Engineer managing OpenStack environments for Cloudera. Deploying, troubleshooting, and improving OpenStack systems with Kubernetes integration.
About the role
- Senior Data Platform Engineer optimizing data processes for a Montreal IT consulting firm. Involving governance, ingestion pipelines, and scalable architecture in data management.
Responsibilities
- Deliver curated, reusable datasets for BI, analytics, and ML.
- Build and run ingestion, transformation, and serving pipelines (batch and streaming).
- Implement governance: ownership, PII handling, RBAC, retention, audit and compliance.
- Set up and monitor data quality and observability (checks, alerts, incident handling).
- Design and own scalable data platform architecture (lake/Lakehouse/warehouse).
- Define and track dataset SLOs/SLAs (freshness, completeness, latency).
- Define and enforce data standards: modeling, layering, naming, metadata, contracts.
Requirements
- 6+ years in data architecture, data engineering, and DataOps (production environments)
- Strong SQL experience
- Strong Python experience
- Experience building and maintaining production data pipelines
- Experience designing and operating cloud data platforms (AWS and/or Azure or equivalent)
- Experience with data lakes, Lakehouse, and/or data warehouses
- Experience with data modeling and layering
- Experience with data contracts and schema management
- Experience with data governance (ownership, PII handling, RBAC, retention, auditability)
- Experience with data quality controls and observability
- Experience with metadata and data lineage
- Experience with CI/CD practices for data systems
- Experience with infrastructure as code (e.g., Terraform or equivalent)
- Experience with batch and streaming data processing
- Experience with at least one orchestration tool (Airflow, Dagster, Prefect, or similar)
- Experience with at least one transformation tool (dbt or equivalent)
- Experience with at least one streaming system (Kafka, Kinesis, Event Hubs, Flink, or Spark Streaming)
- Experience with Lakehouse table formats (Delta, Iceberg, or Hudi)
- Experience with catalog and governance tools (Purview, Collibra, DataHub, Unity Catalog, or Alation)
- Experience with BI tools (Power BI, Tableau, or Looker)
- Experience with data quality/observability tools (Great Expectations, Soda, or equivalent)
- Familiarity with Kubernetes and containerized workloads
Benefits
- Flexible work arrangements
- Professional development opportunities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Platform Engineer at Cloudera configuring bare - metal servers and managing OpenStack infrastructure. Collaborating with teams to ensure optimized performance and reliability in datacenter environments.
Senior Staff Platform Engineer deploying and managing OpenStack environments at Cloudera. Collaborating with teams to improve integration with Kubernetes and contribute to open - source development.
Senior Platform Engineer designing, improving, and scaling infrastructure for Stay22's platform. Collaborating with engineering teams to enhance system performance and reliability.
Lead Data Platform Engineer overseeing design and operation of IoT data platform for Vizzia. Ensure reliable data access and governance while supporting internal teams and AI initiatives.
Platform Engineer ensuring stable operations and excellent developer experience across a hybrid benefits platform. Join our fast - paced team to create impactful solutions in a collaborative environment.
Senior Azure Platform Engineer at Orderfox, evolving the Azure platform for AI agents. Focused on automation, CI/CD, and cost tracking for efficient operations.
Senior Staff Platform Engineer deploying and managing OpenStack environments at Cloudera. Collaborating with teams to integrate OpenStack with Kubernetes and ensure high performance.
Software Engineering Developer at Kyndryl designing and implementing software solutions for clients. Collaborating on complex projects using advanced technologies and methodologies.
AI Platform Engineer at Utica National Insurance Group responsible for evaluating, designing, and implementing AI/ML solutions. Collaborating with internal teams and ensuring effective use of AI - driven tools.