Data Engineer I responsible for supporting AI solutions in Consumer applications at Bank of America. Involved in Hadoop ecosystem, big data technologies, and ensuring system stability.
About the role
- Data Engineer at PayPal leading the design of complex data systems and architectures. Collaborating across teams to ensure data quality and optimize engineering processes.
Responsibilities
- Lead the design and development of complex data pipelines for data collection and processing.
- Develop and maintain advanced data storage solutions.
- Ensure data quality and consistency through sophisticated validation and cleansing processes.
- Collaborate with cross-functional teams to understand data requirements and provide innovative solutions.
- Optimize data engineering processes for performance, scalability, and reliability.
Requirements
- 3+ years relevant experience and a Bachelor’s degree OR Any equivalent combination of education and experience
- Expert-level SQL skills - ability to write and optimize complex queries across large datasets (billions of records)
- Strong experience with both batch processing (Spark, Dataproc) and real-time/streaming systems (Kafka, Pub/Sub, Dataflow)
- Proven ability to build low-latency data systems that solve time-sensitive business problems
- Hands-on proficiency with Cloud data services. Preferably - BigQuery, Bigtable, Dataproc, Cloud Storage, Pub/Sub
- Strong Python programming skills for data pipeline development and automation
- Experience with workflow orchestration tools (Airflow, UC4, or similar)
- Solid understanding of data modeling, schema design, and data warehouse concepts
- Experience with CI/CD pipelines and DevOps practices for data systems
- Strong debugging and troubleshooting skills for distributed data systems
- Ability to work in a fast-paced environment and ramp up quickly on new technologies and domains
Benefits
- generous paid time off
- healthcare coverage for you and your family
- resources to create financial security and support your mental health
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Senior Data Architect defining comprehensive data strategy and architecture for AI. Delivering organization’s data vision and ensuring governance and technical oversight of enterprise data architecture.
Data Engineer at Booz Allen utilizing data to impact critical missions like fraud detection and cancer research. Collaborating with analysts and developers on advanced technology solutions.
Technical Product Manager for Data Engineering at Betclic. Owning product roadmaps, driving data infrastructure evolution, and ensuring alignment across engineering teams.
Senior Data Engineer maturing strategic data assets and delivering business analytics in a regulated financial environment. Collaborating with stakeholders to advance business data strategy on cloud platforms.
Staff Data Engineer leading scalable data solutions for analytics and reporting at Asurion. Designing data pipelines and ensuring data quality across cloud platforms.
Lead Architect at Travelers shaping enterprise database and data platform solutions. Collaborating across technology and business units to drive digital transformation and modernization efforts.
Senior Data Engineer at Porto Bank responsible for developing robust data architecture and ensuring data quality across teams. Collaborating with various data solutions for effective data management.
Data Engineer II at Dun & Bradstreet collaborating with teams to enhance data quality standards and practices. Driving best - in - class data management across diverse disciplines.
Senior Data Engineer at NVIDIA developing and optimizing database architectures while collaborating across software and hardware teams. Focus on data - driven systems in data center environments for complex networking verification.