Skip to content
Mirendil

Member of Technical Staff, Inference

San FranciscoOnsite · United States
Staff · FullTime · Tech
POSTED 24 JUNVERIFIED 1D AGO
Apply Ask
Role
138 days opentrue age
Posted 24 Jun
Payin text
$300k–400kposted
▲ +46% vs market median $240k
$205k$400k
Market p25–p75
$205k–$284k
SF Bay Area · n=969 · 365d to 6 Nov
CompanyMirendil →
15open roles
Opened · 30d
+0
Closed · 30d
−0
30d window
Market
9,275open · Staff Software engineering
Opened · 7d
+4855% of open
All software engineering
75,228open
All tracked boards · live 9 Nov · n=9,275
LLMs

Mirendil

Mirendil is a tech-first company focused on solving core bottlenecks that unlock step-change acceleration across science and technology. Our first goal is to democratize frontier AI R&D across scientific disciplines. We are building a frontier AI research company and training our own models end-to-end.

The Role

We are looking for an engineer to own the inference systems that power our models in production and research. You'll work across the full inference stack, from serving infrastructure down to hardware-level optimization. Some example areas you might work on (not limited to):

Design and build high-throughput, low-latency inference serving systems for frontier models, optimizing for both research iteration and production deployment

Optimize inference performance across GPU and accelerator hardware - maximizing FLOPs utilization, memory bandwidth, and compute efficiency for large-scale models

Enable and extend distributed inference frameworks (e.g. vLLM, SGLang, TensorRT-LLM) to support novel architectures, long-context workloads, and agentic inference patterns

Implement and validate inference-time optimizations: speculative decoding, quantization, KV cache management, and batching strategies

Build observability and reliability infrastructure so the team can measure latency, throughput, and cost across every serving configuration

Partner directly with teams to bring new model architectures and post-training techniques into production quickly

If you're excited about pushing the performance limits of frontier model inference, we'd love to hear from you.

We offer a base salary of $300,000–$400,000 USD and a meaningful equity grant, depending on experience and background, along with competitive benefits.

Source · MirendilFirst seen 7 NovOriginal ↗