Senior Manager leading a team of database engineers to manage CCC's data platform. Overseeing mission - critical applications and collaborating with cross - functional teams in a hybrid environment.
About the role
- AWS Data Architect at Fractal designing and operationalizing AWS data solutions at enterprise scale. Collaborating with clients and mentoring engineers in best practices.
Responsibilities
- Consult, Design, build and operationalize large scale enterprise data solutions using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, Snowflake and Databricks.
- Analyze, re-architect and re-platform on-premises data stores/ Databases to modern data platforms on AWS cloud using AWS or 3rd party services.
- Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala.
- Design and optimize data models on AWS Cloud using AWS data stores such as Redshift, DynamoDB, RDS, S3
- Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
- Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud as part of customer consultation and business proposals.
- Participate in client design workshops and provide trade-offs and recommendations towards building solutions.
- Mentor other engineers in coding best practices and problem solving
Requirements
- 9 to 15 years’ experience in the industry
- Bachelor’s Degree in computer science, Information Technology or other relevant fields
- Experience and knowledge of Big Data Architectures, on cloud and on premise
- Proficiency in AWS Collection Services: Kinesis, Kafka, Database Migration Service
- Proficiency in AWS main Storage Service: S3, EBS, EFS
- Proficiency in AWS main Compute Service: EC2, Lambda, ECS, EKS
- Proven experience in: Java, Scala, Python, and shell scripting.
- Working experience with: AWS Athena and Glue Pyspark, EMR, DynamoDB, Redshift, Kinesis, Lambda, Apache Spark, Databricks on AWS, Snowflake on AWS
- AWS Certification: AWS Certified Solutions Architect and/or AWS Certified Data Analytics
- Working experience with Agile Methodology and Kanban
- Good knowledge of SQL
- Experience in building and delivering proofs-of-concept, in order to address specific business needs, using the most appropriate techniques, data sources and technologies
- Experience partnering with executive stakeholders as a trusted advisor as well as enabling technical implementers
- Working experience in migrating workloads from on premise to cloud environment
- Experience in monitoring distributed infrastructure, using AWS tools or open-source ones
- Experience in monitoring distributed infrastructure, using AWS tools or open-source ones such as CloudWatch, Prometheus, and the ELK stack would be big advantage.
Benefits
- Health insurance
- Flexible working arrangements
- Professional development opportunities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
As a Principal Data Architect at Solstice, lead the design and implementation of data architecture solutions. Ensure data integrity, security, and accessibility to meet strategic organizational goals.
Data Platform Specialist overseeing data workflows and enhancing data quality for Stackgini's AI - driven IT solutions. Collaborating with teams to drive improvements and stakeholder support.
Data Engineer designing data pipelines in Python for a major railway industry client. Collaborate with Data Scientists and ensure code quality with agile methodologies.
Senior Data Engineer responsible for building and optimizing data pipelines for banking analytics initiatives. Collaborating with data teams to ensure data quality and readiness for enterprise use.
Senior Data Engineer developing scalable data solutions on Databricks for analytics and operational workloads. Collaborating with cross - functional teams to modernize the data ecosystem.
Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.