Staff Software Engineer designing and developing scalable search infrastructure for Slack. Collaborating on product features and optimizing data processing pipelines for performance and reliability.
Responsibilities
Design and develop scalable, resilient offline indexing pipelines for Slack's search infrastructure
Work with product engineering on new features for a growing user base
Optimize data processing pipelines for performance, cost-efficiency, and reliability
Collaborate with team members to ensure high availability and data freshness across distributed systems
Actively own indexing pipeline features and improve surrounding data infrastructure
Monitor and optimize pipeline performance while addressing data quality issues
Mentor other engineers and review code
Improve engineering standards, tooling, and processes
Requirements
7+ years of experience in building web applications and operating large-scale distributed systems
Experienced with distributed data processing frameworks such as Spark, Hadoop, Map/Reduce, or EMR
Deep experience with workflow orchestration tools like Airflow
Proficient in languages commonly used for data engineering (e.g., Python, Java, Scala)
Track record of developing high-availability, performant data pipelines across multiple clusters and regions
Strong communication skills for explaining complex technical concepts to diverse teams
Computer science fundamentals: data structures, algorithms, programming languages, distributed systems, and information retrieval
Bachelor's degree in Computer Science, Engineering or related field, or equivalent
Principal Engineer creating engineering solutions within Design & Engineering teams at Arcadis, focusing on renewable energy and sustainable practices.
Senior Principal Engineer overseeing the packaging technology roadmap for AI XPU at Marvell. Collaborating across teams to meet high - performance computing and AI needs with advanced packaging solutions.
Principal Engineer at Marvell developing packaging technology for high performance computing and AI. Collaborating on innovative solutions for complex signal integrity and power delivery networks.
Senior Software Developer optimizing backend services using Node.js and MongoDB at a growing FinTech company in Köln. Focused on architecture decisions, mentoring, and team collaboration.
Senior Full Stack Engineer for AI - powered marketing analytics platform handling dashboards and analytics widgets. Collaborating with a team in a high - energy environment based in Buenos Aires.
Lead Engineer for well delivery projects at Repsol, dealing with technical challenges in drilling operations. Collaborate with diverse stakeholders in a hybrid work arrangement based in Maracaibo, Venezuela.
Software Engineer developing the Python framework for algorithm developers at Mobileye. Building high - performance data streaming libraries and collaborating with researchers in autonomous vehicle technology.
Principal Engineer driving architectural vision for high - performance photo editing experiences at Storio. Collaborating with engineering, product, and design teams in Amsterdam to innovate and personalize customer memories.
Senior Full Stack Developer at E - INFOSOL developing cloud applications and supporting Java solutions. Collaborating with teams and managing cloud infrastructure in a secure environment.
AI/ML Software Engineer Intern defining the AI/ML infrastructure at Nirmata's Policy Management platform. Collaborating on AI - powered features within a fast - moving startup.