Software Engineer, LLM Infrastructure

Join Fireworks AI as a Software Engineer on the AI Infrastructure team to design and build core systems for their generative AI platform. You will focus on ensuring the reliability, performance, and availability of AI systems, partnering with cloud, product, and performance teams to bridge customer needs with the inference engine.

• Design and develop scalable backend infrastructure for distributed training and inference
• Build and maintain core backend services like LLM CI/CD pipelines and model serving systems
• Optimize performance, cost, and reliability across compute, storage, and networking
• Develop frameworks and safeguards for model quality
• Collaborate with cross-functional teams to translate needs into infrastructure solutions
• 3+ years of experience in software engineering with a focus on infrastructure or ML systems