Skip to content
Magic.Dev

Member of Technical Staff, Kernels

San Francisco; RemoteRemote · United States
Staff · FullTime · ML
POSTED 24 JAN 2024
Apply Ask
Role
1020 days opentrue age
Posted 24 Jan 2024
Payats field
$275k–550kposted
▲ +72% vs market median $240k
$205k$550k
Market p25–p75
$205k–$284k
SF Bay Area · n=969 · 365d to 6 Nov
CompanyMagic.Dev →
7open roles
Opened · 30d
+0
Closed · 30d
−0
30d window
Market
9,274open · Staff Software engineering
Opened · 7d
+4885% of open
All software engineering
75,167open
All tracked boards · live 10 Nov · n=9,274

Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone. Our approach combines frontier-scale pretraining, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal.

About the role

As a Kernel Engineer, you will design, implement, and maintain high-performance kernels to optimize throughput and latency during training and inference.

Magic's long-context windows create distinct kernel optimization challenges around memory utilization, data movement, and sustained throughput.

What you'll work on

Design and implement kernels that support high-performance long-context behavior

Ownership of kernel design, implementation, deployment, and production reliability

Focus on robustness, extensive testing, and functional correctness, while pushing on performance

Evaluate porting Magic’s compute kernels to alternative hardware options

Co-design kernels with understanding and interaction with training, inference, and RL teams

For a sample of our work, see Magic-Attention, presented at GTC 2026

What we’re looking for

Low-level programming experience targeting AI accelerators such as NVIDIA Blackwell or Google TPUs

Develop and optimize GPU kernels in frameworks such as NCCL, MSCCLPP, CUTLASS, CuTeDSL, Triton, Quack, Flash-Attention, and similar frameworks

Experience in other kernel authoring frameworks such as Pallas/Mosaic (GPU or TPU), or Mojo also maps well to the work on Magic's kernel team

Strong depth over shallow breadth: for kernel engineering, we prefer candidates with deep expertise in computer architecture, low-level machine optimizations, and code generation, with breadth across ML

Agility, ownership mindset, and grit

Our culture

Integrity. Words and actions should be aligned

Hands-on. At Magic, everyone is building

Teamwork. We move as one team, not N individuals

Focus. Safely deploy AGI. Everything else is noise

Quality. Magic should feel like magic

Magic strives to be the place where high-potential individuals can do their best work. We value quick learning and grit just as much as skill and experience.

Compensation, benefits and perks (US)

Annual salary ranges between $275K - $550K based on experience

Equity is a significant part of total compensation, in addition to salary

401(k) plan with 6% salary matching

Generous health, dental and vision insurance for you and your dependents

Unlimited paid time off

Visa sponsorship and relocation stipend to bring you to SF, if possible

A small, fast-paced, highly focused team

Source · Magic.DevFirst seen 7 NovOriginal ↗