Data Engineer supporting, developing, and maintaining a data analytics platform with agile delivery. Working with business and IT teams to leverage data technologies effectively.
About the role
- Engineering team at Crypto.com responsible for designing and developing software for various ventures projects. Focused on scalable applications and innovative solutions.
Responsibilities
- Manage the daily operations of Hadoop, Spark, Flink, Clickhouse, and other big data platforms to ensure system stability and data security;
- Operate and administer Linux systems, proficient in common commands, with scripting skills in Shell, Python, or similar languages;
- Maintain and operate big data components on cloud platforms (AWS/GCP/Azure), with hands-on experience in container technologies such as Kubernetes and Docker;
- Build and maintain monitoring systems to track platform performance, optimize configurations and resource allocation, and troubleshoot performance issues (tools such as Datadog, Prometheus, Grafana, Zabbix, etc.);
- Deploy, upgrade, and scale core big data components including Flink, Kafka, Spark, Impala,Clickhouse and Kudu;
- Write and maintain technical documentation for operations, and support in platform solution design and upgrades;
- Explore and adopt new technologies to optimize operation processes and provide technical guidance to help client teams improve their capabilities.
- Preferred: Experience on the development of n8n workflow
Requirements
- Familiarity with CDH/CDP/HDP or similar Hadoop distributions, with proven experience in big data platform operations preferred;
- Proficiency in Linux administration and scripting (Shell, Python, or equivalent);
- Experience with major cloud platforms (AWS/GCP/Azure) and containerized environments (Kubernetes, Docker);
- Strong knowledge of big data components and performance tuning, able to resolve stability and scalability issues independently;
- Strong technical writing and communication skills to support documentation and solution delivery;
- Self-motivated with a passion for new technologies, able to apply innovative approaches to optimize operations and drive efficiency.
Benefits
- Competitive salary
- Attractive annual leave entitlement including: birthday, work anniversary
- Work Flexibility Adoption. Flexi-work hour and hybrid or remote set-up
- Aspire career alternatives through us. Our internal mobility program can offer employees a diverse scope.
- Work Perks: crypto.com visa card provided upon joining
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer at Domes Resorts responsible for designing data pipelines and supporting analytics. Join E - Commerce, Intelligence & Innovation team to drive business growth through data solutions.
VP Enterprise Data Architect managing scalable data solutions and architecture for Pacific Life. Leading teams and advancing AI - first data ecosystem.
Senior Data Engineer at Red Hat designing and optimizing 데이터 솔루션 supporting sales and forecasting. Collaborating with teams and applying modern data engineering practices to ensure data quality.
Senior Data Engineer leading the design and implementation of data pipelines for NVIDIA’s analytics and monitoring systems. Collaborating across teams to enhance data ingestion and analysis capabilities.
Associate Data Engineer at Boeing India supporting API Development and Data migration with a focus on engineering and technology solutions. Involves working independently to gather requirements and supporting architecture for API services and data analytics.
Senior Data Engineer building and maintaining robust data pipelines for various data products at Beep Saúde. Collaborating within the team and leading data governance practices.
Software Developer in Test working on cloud - based data platform at Tecsys. Ensuring quality and reliability of data pipelines and transformations using automation frameworks.
Data Engineer responsible for designing, building, and optimizing data pipelines and architectures in a tech environment. Requires extensive experience with modern data warehousing and cloud platforms.
Lead Data Engineer role at Brillio focusing on AI & Data Engineering with expertise in Azure and MS Fabric. Collaborate within the Data Engineering team in Pune, Maharashtra, India.