Data Engineer building data solutions using SQL, Python, and AWS for fintech. Focused on ETL processes and big data technologies to meet business needs.
Responsibilities
Assemble large, complex datasets that meet functional and non-functional business requirements;
Build the infrastructure and delivery solutions required for data extraction, transformation, and loading (ETL), suitable for a wide variety of data sources using PySpark, SQL, AWS and Databricks;
Create diagrams for proposed technical solutions, such as data models, data flows, deployment diagrams, etc.;
Strong programming experience in Python or other object-oriented languages for big data processing;
Design, build, and maintain scalable data pipelines and related data access patterns using big data tools and languages;
Research, evaluate, and adopt new technologies, tools, and frameworks focused on high-volume data processing.
Requirements
Education: Bachelor's degree in Business Administration with specialization or a solid background in Information Systems, Systems Analysis, Computer Science, Software Engineering, Statistics, or Mathematics.
Data analysis skills;
Experience writing SQL queries;
Experience programming in Python;
Knowledge of PySpark for Big Data processing;
Familiarity with the Databricks platform;
Knowledge of Data Modeling;
Experience with AWS and cloud technologies as a whole;
Results-oriented with excellent communication and interpersonal skills;
Adherence to secure development best practices;
Business awareness, focused on building value-driven solutions for customers;
Proactivity;
Initiative;
Experience and understanding of Agile methodologies.
Senior Data Architect defining comprehensive data strategy and architecture for AI. Delivering organization’s data vision and ensuring governance and technical oversight of enterprise data architecture.
Data Engineer at Booz Allen utilizing data to impact critical missions like fraud detection and cancer research. Collaborating with analysts and developers on advanced technology solutions.
Technical Product Manager for Data Engineering at Betclic. Owning product roadmaps, driving data infrastructure evolution, and ensuring alignment across engineering teams.
Senior Data Engineer maturing strategic data assets and delivering business analytics in a regulated financial environment. Collaborating with stakeholders to advance business data strategy on cloud platforms.
Staff Data Engineer leading scalable data solutions for analytics and reporting at Asurion. Designing data pipelines and ensuring data quality across cloud platforms.
Lead Architect at Travelers shaping enterprise database and data platform solutions. Collaborating across technology and business units to drive digital transformation and modernization efforts.
Senior Data Engineer at Porto Bank responsible for developing robust data architecture and ensuring data quality across teams. Collaborating with various data solutions for effective data management.
Data Engineer II at Dun & Bradstreet collaborating with teams to enhance data quality standards and practices. Driving best - in - class data management across diverse disciplines.
Senior Data Engineer at NVIDIA developing and optimizing database architectures while collaborating across software and hardware teams. Focus on data - driven systems in data center environments for complex networking verification.
Senior Data Engineer building reliable data infrastructure for AI - powered health experiences. Collaborating on data pipelines and ensuring data quality in a hybrid work environment.