About this role

As an AI Gateway Cloud Engineer, you will design, deploy, and operate secure and scalable AI gateway platforms across cloud and Kubernetes environments. This role is crucial for enabling standardized access to approved AI models and services by automating provisioning, configuration, and policy deployment. You will implement essential controls for routing, security, and responsible AI to enhance reliability, performance, and cost efficiency.

What we are looking for

6

Design, deploy, and operate secure, scalable AI gateway platforms
Automate platform provisioning, configuration, and release processes
Implement routing, resiliency, traffic, token, caching, and security controls
Apply prompt and response guardrails and responsible AI controls
Establish monitoring, alerting, and operational practices
Partner with security, cloud, data, and architecture teams

Skills mentioned

4

PythonAzureKubernetesLinux