Senior Solutions Architect designing scalable Big Data solutions at Cloudera. Working with customer technical teams to deliver high quality data solutions across Asia Pacific.
Responsibilities
Work directly with customer business and technical teams to understand requirements and develop high quality solutions
Design highly scalable and reliable data pipelines to consume, integrate, and analyze large amounts of data from various sources.
Able to understand big data use-cases and recommend standard design, implementation patterns used in Hadoop-based deployments
Able to document and present complex architectures for the customer’s technical teams
Work closely with Cloudera teams at all levels to ensure project and customer success
Design effective data models for optimal storage and retrieval, deploy inclusive data quality checks to ensure high quality of data
Design, build, tune and maintain data pipelines using Hadoop, NiFi or related data integration technologies
Install, deploy, augment, upgrade, manage and operate large Hadoop clusters
Write and produce technical documentation, customer status reports and knowledge-base articles
Keep up with current Hadoop, NiFi, Big Data ecosystem / technologies.
Requirements
Overall 12+ years IT experience, with at least 4+ years of production experience working with Hadoop and/or NiFi, data engineering.
Hands-on experience with all aspects of developing, testing and implementing low-latency big data pipelines.
Demonstrated production experience in data engineering, data management, cluster management and/or analytics domains.
Experience designing data queries against data in the HDFS environment using tools such as Apache Hive
Experience implementing MapReduce, Spark jobs
Experience setting up multi-node Hadoop clusters
Experience in systems administration or DevOps experience with one or more open-source operating systems
Experience with Data Warehouse design, ETL (Extraction, Transformation & Load), architecting efficient software designs for DW platform.
Experience implementing operational best practices such as alerting, monitoring, and metadata management.
Strong understanding with various enterprise security practices and solutions such as LDAP and/or Kerberos
Experience using configuration management tools such as Ansible, Puppet or Chef
Familiarity with scripting tools such as bash shell scripts, Python and/or Perl
Experience with Apache NiFi is desired
Significant previous work writing to network-based APIs, preferably REST/JSON or XML/SOAP
Understanding of the Java ecosystem and enterprise offerings, including debugging and profiling tools
Ability to understand and translate customer requirements into technical requirements
Pre Sales Solution Architect at Integrity360 focusing on enhancing clients' cybersecurity maturity and architecting security solutions. Collaborating with Account Management and Product Management teams.
Pre Sales Solution Architect at Integrity360 advising clients on cyber security solutions. Collaborating with technical teams and engaging with C - level customers in Belgium.
Senior Solutions Engineer at TeamViewer displaying software solutions value to enterprise customers. Collaborating with sales and product teams in complex digital workplace environments.
Client Success Manager managing major accounts for Cox Automotive in the Atlanta area. Fostering relationships with dealership contacts to drive revenue and ensure client satisfaction.
Solution Architect responsible for designing architectural solutions in R&D at Hempel. Overseeing digital platforms and ensuring compliance with enterprise standards.
Process Integration Engineer developing and advising on new semiconductor packaging modules at Applied Materials. Working in Albany, NY or Santa Clara, CA with diverse global teams.
Data Transport Systems Integration Engineer modernizing multi - cloud environment for USAF. Managing IBM MQ applications and mentoring junior staff while ensuring security and delivery.
Solution Architect analyzing logistics and production processes for a German family - run company. Focusing on digital transformation and effective software solutions in Hungary.
Manager of Solutions Engineering at Kantata leading pre - sales efforts for strategic clients across EMEA. Responsible for team leadership, mentoring, and enhancing sales performance.
Medior Systems Integration Engineer at Arcadis working on impactful projects. Leading systems integration and supporting multidisciplinary teams in the Netherlands.