Applied AI Engineer

As an Applied AI Engineer at FICO, you will be instrumental in ensuring the quality, safety, and performance of our AI-powered consumer features. This role blends backend engineering with hands-on LLM experience to manage and enhance our AI assistants, focusing on prompt engineering, evaluation frameworks, and guardrail development. You will build the essential tooling that empowers our analysts and QA engineers to measure and improve AI systems.

• Own system prompts, tool descriptions, and evaluation prompts for AI features
• Build and grow the LLM evaluation framework and regression suites
• Measure and improve LLM-based evaluator reliability
• Design, tune, and monitor guardrails for AI safety and compliance
• Lead model upgrades and A/B testing for AI features
• Develop tools for Conversation Analysts and QA engineers