Data Engineer transforming legacy on - premises systems to cloud - native architectures for advanced data analytics. Collaborating with teams to build efficient data solutions using Python and AWS.
About the role
- Senior Data Engineer at People Inc. enhancing data integration pipelines and optimizing data lakes for analytics. Collaborating with stakeholders and ensuring data quality in a hybrid work environment.
Responsibilities
- Enhance systems by building new data integration pipelines and adding new data to our data lakes and warehouses while continuously optimizing them.
- Work with internal team members and stakeholders to scope out business requirements and ensure data deliverables are met.
- Champion coding standards and best practices by participating in code reviews and improving internal tools and build processes.
- Ensure the security and stability of infrastructure in a multi-cloud environment.
- Collaborate with Analytics engineers to ensure data integrity and quality of data deliverables.
Requirements
- Degree in a quantitative field, such as computer science, statistics, mathematics, engineering, data science, or equivalent experience.
- A minimum of 5+ years of experience in building and optimizing data pipelines with Python.
- Experience writing complex SQL queries to analyze data.
- Familiarity with window functions and nested subqueries.
- Commendable experience with at least one cloud service platform (GCP and AWS preferred).
- Experience with data at scale using Apache Spark, Beam or a similar framework.
- Familiar with data streaming architectures using technologies like Pub/Sub and Apache Kafka.
- Willingness to learn about new tech stacks, big data technologies, and data pipelining architectures.
Benefits
- medical, dental, vision, prescription drug coverage
- unlimited paid time off (PTO)
- adoption or surrogate assistance
- donation matching
- tuition reimbursement
- basic life insurance
- basic accidental death & dismemberment
- supplemental life insurance
- supplemental accident insurance
- commuter benefits
- short term and long term disability
- health savings and flexible spending accounts
- family care benefits
- a generous 401K savings plan with a company match program
- 10-12 paid holidays annually
- generous paid parental leave (birthing and non-birthing parents)
- voluntary benefits such as pet insurance, accident, critical and hospital indemnity health insurance coverage, life and disability insurance
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Engineering Academy focused on Snowflake and Databricks for professionals interested in expanding their technical capabilities. Fully remote with future office work in Monterrey or Saltillo after completion.
Senior Data Engineer at Intent HQ designing and scaling data platforms. Building high - impact intelligence from millions of customer insights with a focus on performance and reliability.
SAP Data Engineer supporting MERKUR GROUP's evolution into a data - driven company. Responsible for data integration, modeling, and collaboration with various departments in Group Finance.
Data Engineer at Booz Allen Hamilton organizing data and developing advanced technology solutions. Leading data engineering activities for mission - driven projects and mentoring multidisciplinary teams.
Senior Data Engineer at Bristol Myers Squibb developing scalable data pipelines for foundational products. Collaborating with data scientists and IT professionals to ensure data quality and accessibility.
Sr. Data Engineer building and maintaining data infrastructure for Purpose Financial. Collaborating with teams to improve data services and analytics.
Data Engineer II role focusing on developing and maintaining data pipelines for analytics. Collaborating with Data Science and Analytics teams to ensure data quality and reliability.
Senior Data Architecture Specialist designing and maintaining data integration solutions for Morgan Stanley. Involved in building data architecture and optimizing data storage using various technologies.
Lead Data Engineer responsible for building and maintaining the central HR data lake. Collaborating with analysts and business stakeholders for data - driven decision making.