Associate Data Engineer building and maintaining data systems at Incedo. Transforming raw information into accessible datasets for decision - making and collaborating with analysts and data scientists.
About the role
- Senior Data Engineer architecting and maintaining scalable data systems while collaborating with cross-functional teams at SpotOn, aimed at empowering independent restaurants.
Responsibilities
- Architect, develop, and maintain scalable software solutions for our reporting and analytics platforms.
- Design and implement data pipelines, ETL processes, and integrations using ClickHouse, Streamkap, PostgreSQL, Snowflake, MongoDB, Kafka, and AWS.
- Write and Optimize SQL queries that drive merchant reporting outcomes and improve database performance across large-scale, distributed systems.
- Contribute to defining and refining system architectures, including cloud infrastructure and containerization strategies.
- Implement robust data observability monitoring, logging, and alerting solutions using tools like Grafana, Metaplane, and OpenTelemetry.
- Mentor junior and mid-level engineers, promoting technical excellence and best practices.
Requirements
- 5+ years of professional software and data engineering experience.
- Proficient in Python; experience with GO and TypeScript or JavaScript is highly beneficial.
- Extensive experience with databases and data warehouses such as ClickHouse, PostgreSQL, and MongoDB.
- Strong understanding of real-time data streaming and messaging systems, especially Kafka.
- Experience designing and implementing robust ETL pipelines and handling large-scale data migrations.
- Familiarity with cloud services, especially AWS, including IAM roles, S3, RDS, and MSK.
- Proven ability in performance tuning and optimization for high-volume, low-latency data systems.
- Experience applying core data observability principles to create a transparent and resilient data platform.
- Comfortable with containerization technologies such as Docker and orchestration tools like Kubernetes.
- Strong experience with infrastructure as code (IaC) tools and best practices.
- Deep understanding of software development best practices, CI/CD pipelines, and DevOps methodologies.
Benefits
- Offers Equity
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Intern Data Engineer at Flutter Studios learning to create applications in the gaming industry. Join a cross - functional team to implement a basic application in an Agile environment.
AI/Data Engineer at Comcast developing data pipelines and AI solutions for audit processes. Leading team efforts to ensure data quality and compliance with audit objectives across business units.
Senior Data Engineer involved in AWS Cloud and Big Data solutions for Financial Crime. Join CommBank's team to tackle complex data - centric problems with advanced technologies.
Senior Data Engineer leading and mentoring a team in building scalable data pipelines for digital transformation projects in an international software company.
Senior Data Operations Engineer at iKnowHow designing and implementing scalable data - driven applications. Focus on data pipelines, APIs, and collaboration across teams for project success.
Data/AI Engineer supporting innovations in corporate travel with AWS technologies at HRS Group. Collaborating with data teams to develop AI solutions and maintain data pipelines.
AS
Data Engineer developing data solutions for reporting and analytics at Assurant. Implementing and optimizing Data Warehouse solutions in cloud and on - premise environments with Agile methodology.
AI Engineer developing AI - driven analytics for trading at Deloitte. Focusing on scalable data pipelines and collaboration with traders for actionable insights.
Big Data Engineer developing and optimizing data systems at ESET. Collaborating with cross - functional teams to handle and transform vast datasets.