← All jobs · Anyscale

Customer Engineer

Anyscale ·
52
AI-Agency
B45 U65
📍 San Francisco, US Mid 3+ yrs
RayKubernetesTerraformAWSGCPAzurevLLM
TL;DR

Customer Engineer at Anyscale supporting post-sale adoption of the Ray distributed computing platform. Troubleshoot customer issues, advise on ML/LLM workloads, and coordinate with engineering teams on complex infrastructure problems.

Apply at Anyscale →
share:
you'll be redirected to the company's career page

Job description

About Anyscale

At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

About the role

The Customer Engineer will play a crucial role in the customers’ post-sale journey - helping them to onboard, adopt and grow on Anyscale, troubleshooting and resolving open customer tickets and driving consumption.

Anyscale is an ever evolving platform and hence will require close co-ordination with our engineering teams to debug complex issues. This is an exciting role for those who are technically curious and passionate about ML/AI, LLM, vLLM and the role of AI in next generation applications. It’s an opportunity to make a significant impact in a collaborative, fast-paced environment while building a new segment in this space.

In this role, you’ll be able to

Qualifications

Bonus

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.

Anyscale Inc. is an E-Verify company and you may review theNotice of E-Verify Participation and theRight to Work posters in English and Spanish

Apply at Anyscale →

More open roles at Anyscale

Anyscale ⚡ AI-native · 🔄 synced 6h ago
Software Engineer, Ray Serve
📍 Bengaluru, IN 🛠 AI tools welcome at work · Mid
Software engineer at Anyscale building Ray Serve, a production-grade ML serving framework. Focus on distributed systems, model routing, state management, and observability for scaling AI applications to millions of users.
PythonC++RaygRPCKubernetesTensorFlow
79
AI-core
Anyscale ⚡ AI-native · 🔄 synced 6h ago
Distributed LLM Inference Engineer
📍 San Francisco, US · Senior
Distributed LLM Inference Engineer at Anyscale building high-performance inference systems for Ray. Focus on optimizing batch and online inference at scale, integrating vLLM and other open-source engines, and pushing performance boundaries for AI infrastructure.
RayvLLMPyTorchTensorRT-LLMTritonTVM
71
AI-fluent
Anyscale ⚡ AI-native · 🔄 synced 6h ago
Software Engineer, Platform Infrastructure (Foundations)
📍 Bengaluru, IN · Mid
Software Engineer at Anyscale building control plane and data plane infrastructure for distributed AI workloads. Focus on Kubernetes orchestration, cluster scheduling, and cloud-native systems powering the Ray platform.
KubernetesGoPythonAWSAzureGCP
61
AI-fluent
Anyscale ⚡ AI-native · 🔄 synced 6h ago
Staff Software Engineer, Platform Infrastructure (Foundations)
📍 San Francisco, US · Staff
Staff Software Engineer at Anyscale leading infrastructure architecture for Ray, a distributed computing platform. Responsible for control plane and data plane design, Kubernetes-based cloud-native systems, and mentoring senior engineers on scalable AI/ML workloads.
KubernetesGoPythonAWSAzureGCP
61
AI-fluent
Anyscale ⚡ AI-native · 🔄 synced 6h ago
Software Engineer (Ray Core)
📍 San Francisco, US · Senior
Software engineer at Anyscale building Ray Core, a distributed computing backend. Focus on performance optimization, fault tolerance, and reliability of the C++ scheduler and runtime systems.
C++Raydistributed systemsGPU programming
61
AI-fluent