Prompt Engineer refining AI tools for performance and reliability in a mortgage services company. Analyzing large datasets and collaborating on AI behavior improvements.
Responsibilities
Test and refine prompts to improve the accuracy, clarity, and consistency of AI generated responses.
Run AI model evaluations to identify errors, hallucinations, and output inconsistencies.
Apply analytical reasoning to understand business requirements and translate them into effective prompt structures.
Work with large datasets to analyze AI behavior trends, evaluation results, and performance metrics.
Troubleshoot and fix minor code issues (typically in Python) when workflows or automation break.
Use Git for version control, prompt management, and maintaining clean change history.
Review task instructions and ensure prompts align with expected business rules.
Monitor AI agent behavior to ensure performance targets and quality standards are met.
Document prompt variations, test results, data findings, and recommended improvements.
Requirements
Associate or bachelor’s degree in Business, Data Science, AI, Computer Science, or a related field
Basic experience with Python, data manipulation, and scripting to write or debug code as necessary
Experience with Git or similar version control tools
Ability to work with large structured and unstructured datasets
Familiarity with generative AI tools (ChatGPT, Claude, Gemini, etc.) is required.
Excellent written communication skills, especially when documenting findings or prompt adjustments.
Lead Geotechnician at WSP Nederland, focusing on sustainable infrastructure and offshore wind projects. Collaborating with engineers to ensure safety and quality in geotechnics.
Senior Tooling Engineer overseeing tool & die processes for a leading automotive components manufacturer. Responsible for quality, safety, and throughput for all three shifts in the die process.
Electrical Engineer working on the electrical phases of wind and solar projects at Vensolair. Consulting and managing projects while collaborating with engineers and project managers.
Powertrain Calibration Engineer for Ford's Electrified Powertrain Engineering team. Performing calibration duties on Gasoline/Electric Hybrid applications with lab and in - vehicle development responsibilities.
Industrial Engineer supporting forward model and capacity studies in Powertrain Operations. Collaborating with teams to achieve labor targets and optimize process efficiency.
Cloud Operations Engineer at Yooz managing IT infrastructure with a focus on automation and incident resolution. Require strong skills in Azure, Docker, and Kubernetes, and fluency in technical English.
Senior QE Engineer at PAR Technology Corporation focused on quality assurance for software development. Collaborating with teams to improve product reliability and performance testing.
Managed Services Engineer I providing IT services including desktop, application support, and basic administrative duties for Heartland customers. Involves proactive maintenance, remote support, and client communication.
Senior IAM Engineer managing Identity & Access Management for Enpal’s workforce. Focused on secure access through Microsoft Entra ID and implementing IAM processes.