Associate Data Scientist designing and evaluating LLM-based applications for Manulife. Collaborating on AI initiatives and gaining experience in a supportive environment.
Responsibilities
Design and evaluate LLM-based applications, including RAG pipelines, agentic systems, and chat interfaces.
Conduct LLM red-teaming, bias detection, and alignment testing using comparative and statistical analysis techniques.
Build and maintain automated evaluation frameworks for LLM outputs using embedding-based and prompt-based methods.
Develop interactive dashboards and visualizations using Power BI to communicate insights and model performance to stakeholders.
Integrate and test LLMs using OpenAI APIs, Databricks, and Azure AI Services.
Collaborate on the development of fine-tuning and pre-training pipelines for domain-specific use cases.
Work with Vector Databases (e.g., FAISS, MongoDB, Neo4j) to support RAG and semantic search capabilities.
Participate in code reviews, documentation, and agile development cycles with the engineering team.
Requirements
Minimum 1 year of professional (non-academic) experience in data science, machine learning, or AI-related roles.
Strong programming skills in Python and SQL; experience with JavaScript is a plus.
Bachelor’s or master’s degree in computer science, Data Science, AI, or a related field.
Hands-on experience with LLM evaluation, bias detection, or alignment research (preferred).
Proficiency in data visualization tools, especially Power BI (experience with Tableau or similar tools is a bonus).
Familiarity with LangChain, RAG, Ollama, LLM fine-tuning, and embedding-based analysis.
Experience with cloud platforms such as Microsoft Azure and Databricks.
Knowledge of databases including PostgreSQL, MongoDB, Neo4j, and FAISS.
Strong analytical thinking, attention to detail, and a passion for building responsible AI systems.
Benefits
health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage
adoption/surrogacy and wellness benefits
employee/family assistance plans
various retirement savings plans (including pension)
global share ownership plan with employer matching contributions
financial education and counseling resources
generous paid time off program including holidays, vacation, personal, and sick days
Senior Data Scientist at Viber Data implementing deep learning models for recommendations and classifications. Collaborating with management to drive impactful solutions in a data - driven environment.
Finance Data Lead at fintech startup transforming financial data into insights. Own data workflows and partner with teams to maintain financial models and dashboards.
Data Scientist at Aera Technology focusing on optimization and operations research to enhance decision - making. Working with business data to formulate and solve complex optimization problems.
Associate Data Scientist focusing on modeling, analytics, and pipelines at Aera Technology. Delivering decision intelligence solutions for enterprises with Aera Decision Cloud™.
Associate Data Scientist supporting customers in leveraging AI to enhance decision making. Investigating datasets and collaborating with teams to improve model performance in a hybrid work environment.
Staff Data Scientist at b_labs, leading MLOps strategy for B.TECH's decisioning engines. Driving innovation in Fintech through advanced machine learning and data science solutions in a hybrid environment.
Senior Data Analyst supporting strategic business decisions with data insights in the energy sector at A2A. Collaborating with teams to automate reporting and enhance data quality and governance.
Delivery Data Manager managing critical client data for financial data provider FE fundinfo. Collaborating across global teams to ensure accuracy and integrity of fund data.
Data Science Analyst at TransUnion focused on data insights in analytics initiatives. Requires a bachelor's degree and significant experience with technologies like SQL, R, and Tableau.
Data Scientist working at HP analyzing complex data sets using statistical techniques. Developing data - driven models and insights to improve organizational performance while mentoring project teams.