About this role

Scale AI is seeking an AI Infrastructure Engineer to design and build platforms for scalable, reliable, and efficient serving of LLMs. You will work on a collaborative team to bridge research and engineering, delivering seamless experiences and accelerating innovation.

What we are looking for

6

Build and maintain fault-tolerant, high-performance systems for serving LLMs
Develop an internal platform for LLM capability discovery
Collaborate with researchers and engineers to integrate and optimize models
Conduct architecture and design reviews for scalability
Develop monitoring and observability solutions
Lead projects end-to-end

Skills mentioned

7

PythonC++RustAWSDockerKubernetesTerraform