← All jobs · Together AI

Manager, Infrastructure Strategy & Operations

Together AI ·
40
AI-Agency
B25 U65
📍 San Francisco, US 🌐 Remote/hybrid 💰 $220K–$260K 🛠 AI tools welcome at work Manager 5+ yrs
ExcelGoogle SheetsSQLClaude Code
TL;DR

Manager of Infrastructure Strategy & Operations at Together AI, an AI-native cloud company. Owns analytical backbone for compute infrastructure sourcing, vendor evaluation, and deployment strategy across multiple sites. Builds dashboards, runs capacity planning analyses, and synthesizes market data into decision frameworks for leadership.

Apply at Together AI →
share:
you'll be redirected to the company's career page

Job description

About The Role

Together AI is rapidly scaling its compute infrastructure across multiple sites and deployment types. The Manager, Infrastructure Strategy & Operations role will be the analytical backbone of the Infrastructure Strategy team, owning the research, benchmarking, and decision frameworks that shape how we source, evaluate, and deploy compute at scale.

You will sit at the center of real-time sourcing and vendor decisions, owning the market intelligence, site comparisons, and operational analysis that drive infrastructure strategy. You will produce the domain-specific inputs that inform cross-functional decisions with Finance, Infra Eng, and leadership.

Responsibilities

Requirements

Nice to Have

About Together AI

Together AI is an AI-native cloud company building the infrastructure to make AI faster, cheaper, and more accessible. We're rapidly scaling our GPU footprint: signing our own data center leases, building large-scale clusters, and expanding toward a global owned-infrastructure presence. Our research team has contributed to breakthroughs like FlashAttention, Hyena, and RedPajama, and we co-design across software, hardware, and algorithms to push the frontier of AI efficiency.

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $220-260K + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. Please see our Privacy Policy at https://www.together.ai/privacy

Apply at Together AI →

More open roles at Together AI

Together AI ⚡ AI-native · 🔄 synced 7h ago
AI Researcher, Core ML (Turbo)
📍 San Francisco, US · Senior
AI Researcher, Core ML at Together AI building efficient inference and RL/post-training systems. Role spans algorithms, inference engines (SGLang, vLLM), and production-scale RL pipelines to optimize model speed, cost, and capabilities.
PythonSGLangvLLMGRPORLHFDPO
88
AI-core
Together AI ⚡ AI-native · 🔄 synced 7h ago
Staff Machine Learning Engineer, Voice AI
📍 San Francisco, US · Staff
Staff ML Engineer at Together AI optimizing voice model inference infrastructure. Focus on serving engines (vLLM, SGLang, TRT-LLM), GPU optimization, and productionizing STT/TTS/speech-to-speech models at scale.
vLLMSGLangTensorRT-LLMPythonPyTorchCUDA
82
AI-core
Together AI ⚡ AI-native · 🔄 synced 7h ago
Research Engineer, Core ML
📍 San Francisco, US · Staff
Research Engineer, Core ML at Together AI building production inference and RL/post-training systems. Focus on efficient inference algorithms, speculative decoding, and scaling RL pipelines to optimize latency, throughput, and model quality.
PythonSGLangvLLMATLASPyTorchGRPO
82
AI-core
Together AI ⚡ AI-native · 🔄 synced 7h ago
Forward Deployed Engineer (Inference & Post-Training)
📍 San Francisco, US 🌐 Remote 💰 $270K–$300K 🛠 AI tools welcome at work · Senior
Forward Deployed Engineer at Together AI optimizing inference engines and post-training pipelines for strategic customers. Hands-on technical partner advising on model deployment, fine-tuning, and production scaling.
vLLMTensorRT-LLMSGLangPythonLoRADPO
79
AI-core
Together AI ⚡ AI-native · 🔄 synced 7h ago
Forward Deployed Engineer (GPU Clusters)
📍 San Francisco, US 🌐 Remote 💰 $270K–$300K · Senior
Forward Deployed Engineer at Together AI supporting large-scale GPU cluster deployments for AI model builders. Responsibilities include cluster hardening, infrastructure optimization, Kubernetes/SLURM tuning, and benchmarking to ensure customer success on high-performance training workloads.
KubernetesSLURMInfiniBandRoCENVLinkPython
73
AI-fluent