Staff Software Engineer at Crusoe leading architecture and operations of a large-scale observability platform for AI infrastructure. Focus on telemetry systems (metrics, logs, traces), Kubernetes, and reliability across multi-region cloud infrastructure.
Crusoe is on a mission to accelerate the abundance of energy and intelligence. As the only vertically integrated AI infrastructure company built from the ground up, we own and operate each layer of the stack — from electrons to tokens — to power the world's most ambitious AI workloads. When you join Crusoe, you join a team that is building the future, faster.
We're in the midst of the greatest industrial revolution of our time. The demand for AI compute is boundless, and power is a bottleneck. We're solving that — with an energy-first approach that makes AI infrastructure better for the world and faster for the people innovating with AI.
We're looking for problem-solving, opportunity-finding teammates with a sense of urgency, who believe in the scale of our ambition and thrive on a path not fully paved — people who want to grow their careers alongside a team of experts across energy, manufacturing, data center construction, and cloud services.
If you want to do the most meaningful work of your career, help our customers and partners advance their AI strategies, and be part of a high-performing team that believes in each other, come build with us at Crusoe.
We are looking for a Staff Software Engineer to lead the architecture and evolution of Crusoe’s observability platform at scale. In this role, you will define and drive the strategy for how telemetry is collected, processed, and leveraged across Crusoe’s global cloud infrastructure.
You will architect and operate a highly scalable observability platform that powers reliability, performance insights, and operational excellence across Crusoe’s AI-optimized cloud. Your work will enable engineers to deeply understand the behavior of complex distributed systems through metrics, logs, and traces while ensuring the observability platform itself remains reliable, efficient, and scalable.
As a Staff engineer, you will operate as a technical leader across organizations — shaping Crusoe’s observability roadmap, influencing platform architecture, and partnering closely with infrastructure, AI platform, and product teams to embed observability best practices across the company.
Leading the architecture and long-term strategy for Crusoe’s observability platform supporting multi-region, multi-datacenter Kubernetes infrastructure
Designing and operating large-scale telemetry systems (metrics, logs, traces) capable of supporting high-volume AI/ML, GPU, and distributed workloads
Architecting end-to-end telemetry pipelines, including ingestion, storage, indexing, querying, and visualization layers
Driving adoption and evolution of Crusoe’s monitoring ecosystem, including Prometheus, Alertmanager, Thanos/Cortex/Mimir, Grafana, and OpenTelemetry
Designing highly scalable log ingestion and processing pipelines using technologies such as Fluent Bit, Vector, Loki, or ELK/OpenSearch
Building and evolving distributed tracing platforms (Tempo, Jaeger, OpenTelemetry) integrated with service meshes, APIs, and networking layers
Establishing observability standards across the organization, including SLIs, SLOs, error budgets, and instrumentation best practices
Driving reliability and cost efficiency improvements across telemetry pipelines operating at massive scale
Automating provisioning and lifecycle management of observability infrastructure using Kubernetes, Terraform, and internal tooling (Go, Python)
Embedding security and multi-tenancy into the observability platform, including RBAC, TLS, secrets management, and tenant isolation
Partnering with platform and product engineering teams to integrate observability into services, infrastructure, and development workflows
Mentoring engineers and providing technical leadership across the Cloud Availability organization
Influencing platform architecture decisions and shaping the long-term roadmap for observability and reliability at Crusoe
10+ years of experience in infrastructure, platform engineering, or distributed systems, with deep expertise in observability platforms
Extensive experience building and operating telemetry systems at scale, including:
Metrics platforms (Prometheus, Thanos, Cortex, Mimir)
Logging pipelines (Fluent Bit, Vector, Loki, ELK/OpenSearch)
Tracing systems (Jaeger, Tempo, OpenTelemetry)
Strong programming skills in Go or Python, with experience building infrastructure tooling, operators, or platform automation
Experience operating observability platforms in large Kubernetes environments across multi-region or multi-datacenter infrastructure
Deep understanding of distributed systems, reliability engineering, and performance debugging in complex production environments
Proven ability to design and scale telemetry pipelines handling high-cardinality and high-throughput data workloads
Experience driving cross-team technical standards and influencing platform adoption across engineering organizations
Strong leadership and mentorship capabilities, helping engineers and teams improve observability maturity
Contributions to open-source observability projects (Prometheus, OpenTelemetry, Grafana, Loki, etc.)
Experience supporting AI/ML infrastructure or GPU-heavy compute environments
Experience with event streaming or telemetry pipelines using Kafka, NATS, or Pulsar
Experience implementing cost optimization strategies for large-scale observability platforms
Background in incident response, chaos engineering, and resilience testing
Industry competitive pay
Restricted Stock Units in a fast growing, well-funded technology company
Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
Employer contributions to HSA accounts
Paid Parental Leave
Paid life insurance, short-term and long-term disability
Teladoc
401(k) with a 100% match up to 4% of salary
Generous paid time off and holiday schedule
Cell phone reimbursement
Tuition reimbursement
Subscription to the Calm app
MetLife Legal
Company paid commuter benefit; $300 per month
Compensation will be paid in the range of $209,000 – $253,000 + Bonus. Restricted Stock Units are included in all offers. Compensation will be determined by the applicant’s education, experience, knowledge, skills, and abilities, as well as internal equity and alignment with market data.
Crusoe is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.