AI/ML Engineer designing and refining prompts and workflows using large language models. Responsible for developing data pipelines and delivering scalable AI solutions in a hybrid work environment.
About the role
- Data Engineer responsible for designing and developing data solutions for a major corporation in the food distribution industry. Collaborate in a dynamic team environment and implement scalable data applications.
Responsibilities
- Designing and developing data solutions for one of the world’s largest corporations involved in the marketing and distribution of food products
- Implementing distributed and highly available data processing applications that scale for enterprise demands
- Adhering to Continuous Integration and Continuous Delivery (CI/CD) of solutions
- Ensuring high code quality by following software engineering best practices
- Working collaboratively in a cross-functional team within an Agile delivery environment
- Adhering to DevOps principles and being involved in projects throughout their full software lifecycle — from development, QA, and deployment to post-production support
Requirements
- A Bachelor’s Degree in Computer Science or equivalent
- 5 years of experience in developing enterprise-grade data processing applications
- A strong programming background in data operations (Python, Shell, SQL)
- Experience in processing large volumes of data
- Hands-on experience working with relational/ NoSQL databases and distributed storage engines (HDFS, S3, Redshift)
- Hands-on experience in ETL design and development using ETL tools (preferably Informatica and cloud tools such as AWS Data Pipelines, Glue, Lambda, EMR, Spark, Hive, and data engineering tools/services on Google Cloud Platform)
- Experience in working with streaming data (using tools such as Kinesis, Kafka, Storm, Spark) will be an added advantage
- Experience in API development and user interfaces and related tools (NodeJS, AngularJS, HTML) will be an added advantage
- Experience working in a Scrum Agile delivery environment and DevOps practices
- Experience in code management and CI/CD tools such as GitHub, GitLab, and Jenkins
- Experience in an agile environment and aligning pod members on technical visions and implementation paths
- A strong desire to continue to grow your skillset
- Strong communication skills that are influential and convincing
Benefits
- Competitive compensation
- Recognition & appreciation
- Training & certifications funded
- International exposure
- Open work culture
- Recreational activities & events
- Medical claims & insurance
- Bonus entitlement
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
AWS Data Architect at Fractal designing and operationalizing AWS data solutions at enterprise scale. Collaborating with clients and mentoring engineers in best practices.
Senior Data Engineer driving data - driven success at Pacific Life. Collaborating with a team to build scalable and secure data solutions in Newport Beach, CA or Charlotte, NC.
Data Architect managing Commercial Data architecture initiatives for Valmet's sales and service team. Leading AI - driven data integrity and quality efforts in a global context.
Data Solutions Architect leading business intelligence solutions and analytics at Crowe. Overseeing data pipelines and analytics frameworks to drive decision - making and compliance.
Senior Lead Data Engineer designing and building scalable data solutions utilizing AI technology for a globally recognized financial institution. Serving sophisticated clients across the globe.
Data Engineer Consultant building and maintaining enriched data infrastructure for analytical thinking at Northwest Permanente. Involves data collection, cleansing, and transformation for business intelligence.
Vice President - Business, Data Architect role at TD Securities focusing on business data architecture and analytics capabilities. Collaborate with stakeholders to define and govern data models and ensure alignment with strategy.
Senior Data Engineer building and implementing data pipelines at Headspace. Collaborating with analytics and data science teams to enhance personalized mental health support.
Staff Data Engineer at Headspace building privacy - first data platforms for mental health support. Leading data engineering strategies and mentoring team members to enhance data - driven decision making.