Software Engineer, RL Data

As an RL Data Engineer at Cursor, you will be instrumental in shaping the intelligence of our AI models by defining and creating the training data they learn from. You will design and build sophisticated environments and evaluation systems that push our agents to solve complex problems, directly impacting the capabilities of future models.

• Design and build training environments that mimic production systems
• Develop grading systems for open-ended tasks
• Create automated checks for reward hacking and environment integrity
• Scale data production from thousands to millions of tasks
• Strong software engineering fundamentals in Python
• Experience building data pipelines, test infrastructure, or backend services