About this role

Trellix is seeking a Staff Software Engineer to build evaluation and benchmarking infrastructure for their AI platform. This role focuses on data science and AI engineering, involving the design of evaluation frameworks, dataset curation, and performance measurement of AI agents and knowledge graphs within the cybersecurity domain.

What we are looking for

6

Architect and implement evaluation pipelines for agentic AI systems
Design and execute model evaluations for LLMs and agentic systems
Develop methods to validate knowledge graph quality and correctness
Build, curate, and maintain high-quality datasets for AI models
Define and instrument evaluation metrics and surface insights
Collaborate with AI engineers, product managers, and security researchers

Skills mentioned

4

PythonReactAWSData Science