Senior Software Engineer, Backend
About the Company
This company is solving one of the toughest challenges in AI infrastructure today: enabling high-velocity iteration while maintaining seamless production-readiness for AI workloads at scale.
Their open-source orchestration platform is an emerging standard for modern data and AI workflows, with numerous leading technology organizations running millions of mission-critical workloads on the platform.
They have a deep bench of infrastructure experts from top technology companies and a technical founding team who originally created the platform at a prior organization.
About the Role
We’re looking for a Senior Software Engineer to join the backend team and help build infrastructure that powers AI workloads at scale.
You’ll design and implement core services in Go, work across multiple cloud environments, and collaborate with customers and internal teams to deliver reliable, low-latency systems.
This role is ideal for someone who enjoys solving complex distributed systems problems, cares deeply about performance, and wants to work at the intersection of cloud infrastructure and machine learning.
What You’ll Do
- Design, build, and operate backend services in Go that handle high-throughput, latency-sensitive workloads
- Optimize system performance across compute, memory, and network layers—identifying bottlenecks and implementing measurable improvements
- Build and maintain integrations with major cloud providers, abstracting cloud-specific complexity behind clean interfaces
- Architect systems that run reliably across multiple cloud platforms, handling the nuances of each provider
- Collaborate with ML engineers and platform teams to understand workload characteristics and design systems that meet their needs
- Participate in on-call rotations and incident response, continuously improving system reliability
- Influence technical direction through design documents, code reviews, and mentorship
What We’re Looking For
- 5+ years of experience building production backend systems, with strong proficiency in Go
- Demonstrated experience designing and operating large-scale distributed systems (high availability, fault tolerance, horizontal scaling)
- Deep understanding of performance optimization—you can profile code, interpret flame graphs, and reason about latency at the p99 level
- Significant experience with multiple major cloud providers (AWS, GCP, Azure), including compute, networking, and IAM
- Familiarity with Kubernetes, container orchestration, and cloud-native patterns
- Strong communication skills and a collaborative approach to problem-solving
- If located near a major office hub, willingness to follow a hybrid in-office schedule
Nice to Have
- Experience with Python and/or Rust for SDK or tooling development
- Experience building infrastructure for ML/AI workloads (training, inference, data pipelines)
- Background in systems programming, networking, or storage
- Contributions to open-source projects
- Experience with Terraform, Pulumi, or other infrastructure-as-code tools
Benefits & Perks
We know that employees who feel their best can build exceptional things and we are proud to offer competitive benefits that will continue to evolve as team needs grow. Benefits may vary by region.
- Excellent medical coverage — company pays 100% of employee premiums and a majority for dependents
- Generous dental and vision plans — high percentage of premiums covered for employees and dependents
- Meaningful equity in the form of options — all employees share in ownership
- Unlimited time off + company holidays
- 401(k) match — competitive contribution matching structure
- 16 weeks paid parental leave for primary and secondary caregivers
- Flexible work schedule (some limitations apply)
- For in-office employees: meals provided onsite and fully stocked kitchen with snacks and beverages
