Lead Data Engineer responsible for evolving Manna’s data infrastructure for drone delivery. Overseeing data architecture and analytics while building scalable data pipelines.
About the role
- Data Engineer building scalable, high-performance data solutions for Fortune 500 clients at ShyftLabs. Collaborating with cross-functional teams to design and maintain robust data pipelines and systems.
Responsibilities
- Collaborate with cross-functional teams to define requirements and deliver reliable solutions.
- Design, develop, and maintain data pipelines and ETL/ELT processes using Python.
- Build and optimize scalable, high-performance data applications.
- Develop and manage real-time streaming pipelines using Pub/Sub or Apache Beam.
- Participate in code reviews, architecture discussions, and continuous improvement initiatives.
- Monitor, troubleshoot, and optimize production data systems for reliability and performance.
Requirements
- 5+ years of professional experience in software or data engineering using Python.
- Strong understanding of software engineering best practices (testing, version control, CI/CD).
- Proven experience building and optimizing ETL/ELT pipelines and data workflows.
- Proficiency in SQL and database concepts.
- Experience with data processing frameworks (e.g., Pandas).
- Understanding of software design patterns and scalable architecture principles.
- Experience with cloud platforms (GCP preferred).
- Knowledge of CI/CD pipelines and Infrastructure as Code tools.
- Familiarity with containerization (Docker, Kubernetes).
- Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience).
- Excellent problem-solving, analytical, and communication skills.
Benefits
- We are proud to offer a competitive salary alongside a strong insurance package.
- extensive learning and development resources.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer designing, implementing, and optimizing data pipelines for DeepLight AI. Collaborating closely with a multidisciplinary team to analyze large - scale data.
Data Engineer designing and maintaining scalable ETL pipelines at Satori Analytics. Collaborating with teams to deliver high - quality analytics solutions across various industries.
Data Architect responsible for defining enterprise data architecture on AWS and Databricks Lakehouse platforms. Enabling scalable data lakes and enterprise analytics for financial services organizations.
Data Platform Operations Support leading data engineering strategy across projects for EXL. Driving innovation and optimization while collaborating with various teams in the organization.
Manager II leading data engineering projects at Navy Federal Credit Union. Overseeing data governance and quality initiatives while managing engineering teams in a hybrid work environment.
Senior Data Engineer building and maintaining data pipelines for cloud and AI solutions at Qodea. Collaborating with ML engineers and focusing on reliability and performance in a cloud - native environment.
Principal Data Engineer responsible for architecting scalable data pipelines and building high - quality data foundations. Collaborating closely with experts to ensure data readiness for advanced analytics.
Senior Data Engineer at Qodea designing scalable data pipelines and infrastructure. Delivering solutions utilizing cutting - edge tools and collaborating closely with teams for impactful results.
Senior Data Engineer designing and maintaining data pipelines for Qodea's global technology solutions. Collaborating with teams to ensure data quality and governance across platforms.