Member of Technical Staff - Data Science

Arena is seeking a Senior Data Scientist to analyze data from millions of AI evaluations, uncover insights into model behavior, and collaborate with ML researchers and engineers. You will design experiments, build statistical frameworks, and communicate findings to drive the advancement of AI for real-world applications.

• Explore and analyze large, complex datasets to uncover patterns in model behavior
• Formulate and test hypotheses about data quality and model performance
• Build reproducible analysis pipelines using Python, Pandas, NumPy, and Spark
• Partner with ML researchers and engineers to design evaluation metrics
• Develop causal reasoning frameworks and statistical methods
• Communicate insights to technical and non-technical partners