Senior Software Engineer – AI Infrastructure

Responsibilities

• Design and build the infrastructure layer powering AI agent systems in production

• Develop high-performance Rust services that handle model inference, orchestration, and execution

• Architect scalable systems capable of supporting millions of users and high request throughput

• Build reliable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring

• Define guardrails, observability, and failure handling for agent-driven workflows

• Optimize latency, throughput, and cost across inference and orchestration layers

• Partner closely with the Agent Systems team to translate experimental prototypes into hardened production systems

• Contribute to foundational infrastructure decisions in a high-scale, high-impact environment

Requirements

• 5+ years of experience building and operating high-scale production systems

• Strong proficiency in Rust and systems-level programming

• Deep understanding of distributed systems, reliability engineering, and performance optimization

• Experience operating services serving millions of users or high-throughput workloads

• Familiarity with ML infrastructure, model serving, or MLOps in production environments

• Experience designing observability, monitoring, and failure recovery systems

• Strong collaboration skills working across infrastructure and applied engineering teams

• High ownership mindset in high-stakes production environment