Head of Partnerships at Cosmos Labs guiding strategic partnerships in blockchain ecosystem development. Fostering relationships with system integrators and consulting firms for enterprise implementations.
CL
Hybrid Distributed Systems Engineer – Data Platform, Logs and Audit Logs
Posted 5 months ago
About the role
- Distributed Systems Engineer at Cloudflare contributing to logs and audit logs management within the Data Platform. Engage in the development of scalable systems for efficient data handling and delivery.
Responsibilities
- Design, build, and operate a robust logging platform, ensuring reliable logging, and secure data transfer to a wide array of customer destinations and third-party integrations.
- Develop and maintain high-performance data connectors and integrations for our log-shipping products, focusing on usability, scalability and data integrity.
- Create and manage systems for handling comprehensive audit logs, ensuring they are delivered securely and adhere to strict compliance and performance standards.
- Scale and optimise the data delivery pipeline to handle massive data volumes with low latency, identifying and removing bottlenecks in data processing and routing.
- Work closely with Product and other engineering teams to define requirements for a new logging platform and integrations.
- Maintain the operational health of our log delivery platform through comprehensive monitoring and participation in an on-call rotation (with flexibility for out-of-hours technical issue resolution).
- Collaborate on the architectural evolution of our data egress platform, researching and implementing new technologies to improve efficiency and reliability.
Requirements
- 3+ years of experience working in software development covering distributed systems and data pipelines.
- Strong programming skills (Go is preferable), with a deep understanding of software development best practices for building resilient, high-throughput systems.
- Hands-on experience with modern observability stacks, including Prometheus, Grafana, and a strong understanding of handling high-cardinality metrics at scale.
- Strong knowledge of SQL, including experience with query optimisation.
- A solid foundation in computer science, including algorithms, data structures, distributed systems, and concurrency.
- Strong analytical and problem-solving skills, with a willingness to debug, troubleshoot, and learn about complex problems at high scale.
- Ability to work collaboratively in a team environment and communicate effectively with other teams across Cloudflare.
- Experience with data streaming technologies (e.g., Kafka, Flink) is a strong plus.
- Experience with various logging platforms or SIEMs (e.g., Splunk, Datadog, Sumo Logic) and storage destinations (e.g., S3, R2, GCS) is a plus.
- Experience with Infrastructure as Code tools like SALT or Terraform is a plus.
- Experience with Linux container technologies, such as Docker and Kubernetes, is a plus.
Benefits
- Competitive salary
- Flexible work arrangements
- Professional development opportunities
- Paid time off
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Lead Distributed Systems Engineer developing a high - scale, low - latency platform at Salesforce. Managing real - time data ingestion and streaming for Sales Cloud AI agents.
Blockchain & Fraud Models Analyst at ClearBank developing monitoring controls for blockchain - based products. Collaborating with multiple teams to enhance financial crime analytics capabilities.
Distributed Systems Engineer responsible for building Rust - based rollup nodes and sequencers. Designing efficient and secure systems for zero - knowledge proof based products within a fintech startup.
Responsible Officer overseeing virtual asset licensing and compliance within Hong Kong. Requires extensive experience in blockchain, financial markets, and regulatory environments.
Senior Software Engineer focused on designing and maintaining supply chain software solutions. Involving technical leadership and solving complex software challenges within a team.
Innovation Blockchain Manager at RSM focusing on blockchain and digital asset growth. Collaborating with stakeholders to deliver effective, objectives - driven solutions for clients.
Blockchain Senior Associate at RSM developing blockchain applications and supporting innovation initiatives across multiple platforms and business partners.
Data Architect leading data storage strategy across a multi - product SaaS platform at Magnet Forensics. Unifying independent products into a coherent platform while mentoring engineers and ensuring performance.
SF
Principal Blockchain Platform Engineer designing and operating blockchain infrastructure on AWS and Kubernetes at Fidelity. Managing node operations for Bitcoin, Litecoin, and Ethereum with a focus on performance and security.