Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
About the role
- Principal Software Engineer in Threat Data Platform developing AI-driven tools for threat intelligence automation. Collaborating on robust data pipelines for PANW’s product ecosystem.
Responsibilities
- Drive the end-to-end development of backend features and core components, from initial architectural design and testing to deployment and long-term maintenance.
- Design and optimize high-throughput ETL/ELT pipelines that ingest and transform complex threat data into actionable intelligence within our data warehouse.
- Build and maintain high-performance data warehouses and scalable APIs that serve as the backbone for PANW’s internal security researchers.
- Partner with cross-functional stakeholders to translate complex business requirements into elegant, scalable technical solutions.
- Champion engineering excellence through rigorous code and design reviews, contributing to the team’s architectural roadmap and best practices.
Requirements
- B.S. or M.S. in Computer Science, a related technical field, or equivalent practical software engineering experience.
- 5+ years of hands-on experience building large-scale enterprise applications and high-availability data APIs.
- Professional-level proficiency in Java (core backend) and a strong command of RESTful API design.
- Proven experience with major cloud providers (GCP preferred or AWS) and their managed services.
- Experience with Python for data manipulation, alongside expertise in Linux environments and shell scripting.
- Strong grasp of varied database architectures, including SQL, NoSQL, Time-series, and GraphDB.
- Experience operating within Kubernetes (K8s) environments and a solid understanding of modern CI/CD workflows.
- Familiarity with building complex analytical solutions and optimizing data pipelines for machine learning or AI-driven insights.
- Specific experience with GCP services such as Pub/Sub, Kafka, Dataflow, Spark, BigQuery, and BigTable.
- Experience with GraphDB specifically for threat relationship mapping.
Benefits
- A description of our employee benefits may be found here.
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.
Data Engineer Manager at PwC focusing on building data infrastructure and solutions. Leading data engineering projects to transform raw data into actionable insights and drive business growth.
Junior Data Engineer at OneMarketData focusing on data quality and integrity in financial datasets. Collaborating with senior analysts and assisting in data management and analysis tasks.
Data Engineer Manager leading robust data solutions for PwC's clients. Transforming raw data into actionable insights and coaching team members.
Senior Data Engineering Analyst developing and implementing data solutions. Collaborating in a diverse environment focused on data processing and analysis for clients' digital transformation.
Senior Azure Data Engineer maintaining business intelligence solutions for Grupo Gloria, implementing and stabilizing projects in Azure and Databricks with Power BI reporting.
Staff Data Engineer at URBN developing AI - powered digital experiences by integrating algorithmic solutions with creative tools. Collaborating with cross - functional teams for impactful product evolution.
Senior Data Engineer at Anglian Water responsible for scalable data solutions and team collaboration. Leading design, build, and operation of secure data pipelines for critical services.