Research Engineer, LangSmith Engine

Langchain is seeking an experienced Research Engineer to enhance the capabilities and efficiency of their LangSmith Engine, which proactively improves AI agents. You will study agent failures, develop benchmarks, conduct experiments to boost performance, and implement successful ideas into production systems. This role requires understanding production engineering trade-offs like cost, latency, and reliability.

• Build and maintain benchmarks and evaluations for Engine agents
• Design and run experiments to improve agent performance
• Implement post-training and fine-tuning techniques for LLMs
• Turn successful experiments into production improvements
• Define ML roadmap and technical direction for Engine agents
• Mentor other engineers