Senior Data Engineer for Semrush, developing scalable data pipelines and optimizing data systems. Collaborating with teams for analytics and mentoring junior engineers in best practices.
Responsibilities
Lead the Design and development of scalable data pipelines and infrastructure
Optimize the performance of data systems and troubleshoot complex data issues
Collaborate with data scientists to ensure data is structured and available for advanced analytics
Mentor and guide junior data engineers, providing technical leadership and support
Ensure data security, privacy, and compliance with organizational policies
Manage the integration of new data sources and ensure data quality
Continuously evaluate and adopt new technologies to improve data engineering practices
Contribute to architecture decisions
Requirements
High level of proficiency in Python, SQL
Good knowledge of Linux and Unix Shell scripting
Experience with GCP, or other cloud providers
Experience with Airflow or similar workflow orchestration tools
Experience with column and/or transactional databases
Understanding of distributed systems and scalable data architectures
Experience writing clean, maintainable, and well-tested code
Strong sense of delivery ownership, balancing speed of execution with adherence to established engineering standards, best practices, and quality requirements
Shipping solutions efficiently without compromising code quality, reliability, or maintainability, even under tight timelines
Actively driving alignment and collaboration across cross-functional teams
Not required, but a plus: Experience with ClickHouse; Pipeline testing experience in Airflow (DAG validation, unit/integration testing); Expertise with containerisation and infrastructure-as-code (Docker, k8s, Terraform); Familiarity with monitoring and logging tools (Grafana, Prometheus, ELK); Hands-on experience with CI/CD pipelines and automated deployment workflows
Senior Data Engineer developing and maintaining data pipelines and solutions for EMC's data analytics products. Collaborating with cross - functional teams to ensure high - quality data management and governance practices.
Principal Product Manager leading product strategy for health data platform at PointClickCare. Collaborating across teams to optimize health data for analytics and care delivery.
Senior Data Engineer designing and optimizing data platforms for clients using Microsoft Azure, Microsoft Fabric, Power BI, and Databricks. Working closely with clients to deliver scalable solutions.
Data Engineer providing technical expertise on mission - critical NAVSUP OIS program. Work involves data architecture and database management in AWS GovCloud environments.
Senior Data Engineer focusing on data infrastructure for an AI - driven insurtech startup based in Nepal. Collaborating with teams to optimize data models and maintain data quality.
Senior Professional Consultant leading architecture and design for SAP BW and SAC solutions at Freudenberg. Collaborating with stakeholders and optimizing performance of data landscapes.
Senior Data Engineer designing and managing data architectures to transform large - scale data into insights for Humana. Involves leading technical discussions and implementing best data practices.
Data Engineer II at Early Warning Services developing data science tools and infrastructure. Collaborating on software enhancements and mentoring interns in a hybrid work environment.
Senior Data Architect responsible for optimizing data architecture and supporting data - driven business decisions at TruStage. Leading technical guidance for data architecture and cross - functional team collaboration.