Senior Manager leading a team of database engineers to manage CCC's data platform. Overseeing mission - critical applications and collaborating with cross - functional teams in a hybrid environment.
About the role
- Principal Data Engineer at Mashreq Bank designing and maintaining scalable data pipelines. Collaborating with teams to improve data models and ensure data quality and accessibility.
Responsibilities
- Develops and maintains scalable data pipelines of batch and real-time to support continuing increases in data demands of volume and complexity.
- Leading data engineering team and ensuring best practices and quality on the deliveries.
- Designs and Develops Data domains across banking products and laying foundation for Data Mesh architecture.
- Demonstrate deep knowledge and experience in databases, Datamart's, Data Modelling, Data Governance, Data Security, BI tools, ETL Solutions.
- Data Orchestration and Data-Ops practices enabler for the team
- Collaborates with analyst, data scientists and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.
- Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Writes unit/integration tests, contributes to engineering wiki, and documents work.
- Experience in Automating Deployment, scheduling, monitoring, and management of datasets and pipelines
- Understand business requirements and identify key performance indicators (KPIs) in Data Engineering.
- Design data models to transform raw data into meaningful insights.
- Ability to Debug Data issues in data platforms and Provide L2, L3 Production support as per SLA.
Requirements
- Principal Data engineer with a solid technical background and experience in data-intensive systems (> 15 years)
- Strong experience in Big Data, Hadoop Ecosystem, Spark Streaming, Kafka, Python, SQL, Hive, NIFI, Airflow
- Proficient with Azure Cloud services such as Azure Data Factory (ADF), Databricks, ADLS, Azure Synapse, Logic Apps, Azure Functions. Or similar data stack knowledge within Google/AWS cloud services
- Proficiency in relational SQL, Graph and NoSQL databases.
- Proficiency in Elastic Search and Couchbase databases
- In-depth skills in developing and maintaining ETL/ELT data pipelines.
- Experience in data modelling techniques such as Kimball star schema, 3NF, vault modelling etc.
- Experience in workflow management tools such as Airflow, Oozie and CI/CD tools
- Data streaming solution in Kafka or Confluent Kafka
- Hands on experience in Google Big Query, Google Analytics & Clickstream Data Model
- Reporting knowledge in Power BI, Tableau, Qlik etc.
- Sound in Data Management Fundamentals and Data Architect, Modelling, Governance
- Strong Domain Knowledge in Banking/Finance area like understanding of the various processes, products, and services within the banking industry, core functions, regulations, and operational aspects of banking institutions
- Hands on knowledge in Hadoop and Azure/AWS cloud ecosystem and ETL jobs migration
- Knowledge of Advance Analytics and AI tools
Benefits
- People management responsibilities encompass the tasks and activities involved in leading, guiding, and developing a team of individuals to achieve organizational goals effectively.
- Setting clear performance expectations, conducting regular performance reviews, providing feedback, and offering guidance on areas of improvement.
- Follow predefined processes and workflows to carry out specific tasks and activities accurately and in a timely manner.
- Identify opportunities for process improvement and efficiency enhancement and provide feedback or suggestions to optimize workflows.
- Analyze the needs, expectations, and concerns of each stakeholder. Assess their level of influence, interest, and potential power to affect the project's success.
- Developing a comprehensive project plan that outlines the project scope, objectives, deliverables, timelines, resource requirements, and budget.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
As a Principal Data Architect at Solstice, lead the design and implementation of data architecture solutions. Ensure data integrity, security, and accessibility to meet strategic organizational goals.
Data Platform Specialist overseeing data workflows and enhancing data quality for Stackgini's AI - driven IT solutions. Collaborating with teams to drive improvements and stakeholder support.
Data Engineer designing data pipelines in Python for a major railway industry client. Collaborate with Data Scientists and ensure code quality with agile methodologies.
Senior Data Engineer responsible for building and optimizing data pipelines for banking analytics initiatives. Collaborating with data teams to ensure data quality and readiness for enterprise use.
Senior Data Engineer developing scalable data solutions on Databricks for analytics and operational workloads. Collaborating with cross - functional teams to modernize the data ecosystem.
Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.