Senior Data Engineer responsible for building and optimizing data pipelines for banking analytics initiatives. Collaborating with data teams to ensure data quality and readiness for enterprise use.
About the role
- Data Engineer developing big data applications for Synchrony in Hadoop ecosystem. Collaborating in an Agile team to ensure high-quality data ingestion and compliance standards.
Responsibilities
- Develop big data applications for Synchrony in Hadoop ecosystem
- Participate in the agile development process including backlog grooming, coding, code reviews, testing and deployment
- Work with team members to achieve business results in a fast paced and quickly changing environment
- Work independently to develop analytic applications leveraging technologies such as: Hadoop, NoSQL, In-memory Data Grids, Kafka, Spark, Ab Initio
- Provide data analysis for Synchrony’s data ingestion, standardization and curation efforts ensuring all data is understood from a business context
- Identify enablers and level of effort required to properly ingest and transform data for the data lake. Profile data to assist with defining the data elements, propose business term mappings, and define data quality rules
- Work with the Data Office to ensure that data dictionaries for all ingested and created data sets are properly documented in data dictionary repository
- Ensure the lineage of all data assets are properly documented in the appropriate enterprise metadata repositories
- Assist with the creation and implementation of data quality rules
- Ensure the proper identification of sensitive data elements and critical data elements
- Create source-to-target data mapping documents
- Test current processes and identify deficiencies
- Investigate program quality to make improvements to achieve better data accuracy
- Understand functional and non-functional requirement and prepare test data accordingly
- Plan, create and manage the test case and test script
- Identify process bottlenecks and suggest actions for improvement
- Execute test script and collect test results
- Present test cases, test results, reports and metrics as required by the Office of Agile
- Perform other duties as needed to ensure the success of the team and application and ensure the team’s compliance with the applicable Data Sourcing, Data Quality, and Data Governance standards.
Requirements
- Bachelor's degree in a quantitative field (such as Engineering, Computer Science, Statistics, Econometrics); in lieu of degree, High School Diploma/GED and minimum 2 years of Information Technology experience
- Hands-on experience writing shell scripts, complex SQL queries, Hive scripts, Hadoop commands and Git
- Ability to write abstracted, reusable code components
- Programming experience in at least one of the following languages: Scala, Java or Python
- Analytical mindset
- Willingness and aptitude to learn new technologies quickly
- Superior oral and written communication skills; Ability to collaborate across teams of internal and external technical staff, business analysts, software support and operations staff.
Benefits
- Flexible work arrangements
- Professional development opportunities
- Annual bonus based on individual and company performance
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Senior Data Engineer developing scalable data solutions on Databricks for analytics and operational workloads. Collaborating with cross - functional teams to modernize the data ecosystem.
Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.
Data Engineer delivering AI - and data - driven solutions for Honeywell’s industrial customers. Architecting and implementing scalable data pipelines and platforms focused on IoT and real - time data processing.
Data Engineering Associate focusing on data quality control and management for distribution platform. Collaborates on large scale data projects to ensure data accuracy and availability for users.
Data Architect managing enterprise data platform built on Microsoft Fabric at Johnstone Supply. Leading architectural standards and collaborating with business and IT leaders for strategic data - driven insights.
Data Engineer at Studyportals responsible for data pipelines and infrastructure. Join a team ensuring accurate and trustworthy data for analytics and business decisions.