Hybrid Software Engineer, Big Data

Posted yesterday

Apply now

About the role

  • Software Engineer building large-scale distributed systems at Quantcast. Collaborating with data science and engineering teams to optimize data processing workflows.

Responsibilities

  • Contribute to the development and optimization of large-scale data workflows using technologies such as Apache Spark or similar frameworks
  • Debug and resolve issues in distributed environments, including data inconsistencies and job failures
  • Maintain and enhance the services that support the distributed storage and compute platform
  • Assist in deploying and maintaining production systems, including CI/CD workflows
  • Work to make our platform more elastic and fault-tolerant
  • Provide technical input into roadmaps for the team
  • Write clean, maintainable, and well-tested code

Requirements

  • BS in computer science or equivalent experience
  • 1-3 years of professional software engineering experience (internships included)
  • You must be work-authorized in the United States without the need for employer sponsorship.
  • Familiarity with data processing frameworks such as Apache Spark, Hadoop, or similar.
  • Familiarity with containerization tools (e.g., Docker and Kubernetes)
  • Experience with workflow orchestration tools (e.g., Airflow) is a plus
  • Proficient in Java and/or Python programming languages
  • Linux system administration/automation experience
  • Strong problem-solving and debugging skills
  • Organized, detail-oriented personality

Benefits

  • Performance bonus
  • Equity
  • Comprehensive benefits package

Job title

Software Engineer, Big Data

Job type

Experience level

Junior

Salary

$144,900 - $168,400 per year

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job