Skip to content
True Talent Solutions Partners

Full-Stack Engineer, Agent Evaluation & Reliability

San FranciscoOnsite · United States
FullTime · Client Roles
POSTED 15 NOVVERIFIED JUST NOW
Apply Ask
Role
0 days opentrue age
Closes in ~1d at the median (1d)
Reposted
×1
Same title, closed before
×1
Posted 15 Nov · n=773
Payats field
$120k–180kposted
▼ −25% vs market median $200k
$120k$265k
Market p25–p75
$165k–$251k
True Talent Solutions Partners p25–p75
$150k–$265kn=27
SF Bay Area · n=159 · 365d to 15 Nov
CompanyTrue Talent Solutions Partners →
195open roles
Opened · 30d
+558
Closed · 30d
−573
10d of snapshots · 30d window
Market
1,627open · Full-stack
Opened · 7d
+20513% of open
All full-stack
3,368open
All tracked boards · live 15 Nov · n=1,627
TypeScriptJavaScriptNode.jsPostgreSQLLLMs

About the Role

Join an AI team building infrastructure for agent evaluation and continuous improvement. This backend-leaning full-stack role combines ownership of core systems with the opportunity to ship product features and work directly with enterprise customers.

What You'll Do

Build backend systems and data models for evaluation datasets, experiment runs, agent traces, knowledge versions, findings, and customer-defined quality criteria.

Develop and support enterprise integrations, including authentication, OAuth, webhooks, incremental syncs, backfills, rate limits, retries, and monitoring.

Own features from technical design and implementation through deployment, monitoring, customer feedback, and iteration.

Work with customers to understand their systems, diagnose issues, and turn specific needs into reusable product capabilities.

Contribute across the stack, building product experiences that make underlying systems useful.

What We're Looking For

At least 2 years of experience building and shipping production systems as a backend or full-stack engineer.

Production experience with TypeScript and Node.js or Bun, PostgreSQL, and job queues or worker systems.

Experience at a fast-paced startup, and a track record of owning projects end-to-end from design through deployment and iteration.

Hands-on machine learning engineering experience, including model development.

Experience building enterprise integrations, including OAuth flows, webhooks, incremental syncs, backfills, and rate-limit handling.

Production experience with agent infrastructure, LLM evaluation, tracing, or agent memory systems is valuable.

Compensation & Benefits

Base salary: $120,000 to $180,000 annually. Visa sponsorship is available.

Location

On-site in San Francisco, California, United States.

Source · True Talent Solutions PartnersFirst seen 15 NovOriginal ↗