Senior Solutions Architect developing scalable solutions using Hadoop and related technologies at Cloudera. Collaborating with APAC Professional Services team and customer technical teams.
Responsibilities
Work directly with customer business and technical teams to understand requirements and develop high quality solutions
Design highly scalable and reliable data pipelines to consume, integrate, and analyze large amounts of data from various sources
Able to understand big data use-cases and recommend standard design, implementation patterns used in Hadoop-based deployments
Able to document and present complex architectures for customer’s technical teams
Work closely with Cloudera teams at all levels to ensure project and customer success
Design effective data models for optimal storage and retrieval, deploy inclusive data quality checks to ensure high quality of data
Design, build, tune and maintain data pipelines using Hadoop, NiFi or related data integration technologies
Install, deploy, augment, upgrade, manage and operate large Hadoop clusters
Write and produce technical documentation, customer status reports and knowledge-base articles
Keep up with current Hadoop, NiFi, Big Data ecosystem / technologies.
Requirements
Overall 12+ years IT experience
At least 4+ years of production experience working with Hadoop and/or NiFi, data engineering
Hands-on experience with developing, testing and implementing low-latency big data pipelines
Demonstrated production experience in data engineering, data management, cluster management and/or analytics domains
Experience designing data queries against data in the HDFS using tools such as Apache Hive
Experience implementing MapReduce, Spark jobs
Experience setting up multi-node Hadoop clusters
Experience in systems administration or DevOps experience with one or more open-source operating systems
Experience with Data Warehouse design, ETL, architecting efficient software designs for DW platform
Experience implementing operational best practices such as alerting, monitoring, and metadata management
Strong understanding with various enterprise security practices and solutions such as LDAP and/or Kerberos
Experience using configuration management tools such as Ansible, Puppet or Chef
Familiarity with scripting tools such as bash shell scripts, Python and/or Perl
Strong understanding of the Java ecosystem and enterprise offerings
Oracle Applications Architect leading architecture, design, and optimization of Oracle ERP solutions at GDIT. Collaborating with teams to ensure safety and security of the nation through modernization efforts.
Solutions Architect leading Software Engineering for Chemistry Applications. Collaborating with engineers and stakeholders at leading chemical companies to enhance R&D processes.
Senior Manager leading design and implementation of integration solutions for enterprise systems at Simpson Thacher. Collaborating with teams to enhance scalability, security, and reliability.
Consulting Solution Architect developing comprehensive security solutions for CDW customers. Collaborating with sales and delivery teams to drive business growth in Hybrid Infrastructure services.
Senior Data & AI Solutions Architect at DXC Technology managing cloud data platforms and AI solutions. Leading architecture design, customer advisory, and implementation efforts in a remote capacity.
Solution Engineer Intern supporting sales engineering efforts and customer success for innovative automation solutions at Stonebranch. Collaborating with experienced engineers on technical evaluations and proof - of - concept projects.
Solutions Architect for NVIDIA's CPU platforms and LPU systems focusing on next - gen AI workloads. Collaborate with customers to enhance AI efficiency and optimize generative AI solutions through architecture and design optimization.
Data Science & Solutions Consultant blending data science and engineering to create impactful AI solutions at twomynds. Involves project development from PoC to live implementation.
WalkMe Builder creating interactive digital guidance solutions for Australian clients. Manage projects from scope to go - live while ensuring user engagement and satisfaction with digital tools.
Solutions Architect supporting sales teams in identifying F5 solutions for customer needs. Collaborating with internal teams and providing technical expertise for revenue growth.