Skip to content
Plenful

Senior Machine Learning Engineer

San Francisco, CA; Seattle, WA; Chicago, IL; New York City, NYHybrid · United States
Senior · FullTime · Engineering
POSTED 29 JUL
Apply Ask
Role
103 days opentrue age
Posted 29 Jul
Payats field
$146k–208kposted
▼ −24% vs market median $233k
$146k$251k
Market p25–p75
$205k–$251k
SF Bay Area · n=149 · 365d to 6 Nov
CompanyPlenful →
14open roles
Opened · 30d
+0
Closed · 30d
−0
30d window
Market
1,501open · Senior ML / AI
Opened · 7d
+987% of open
All ml / ai
6,613open
All tracked boards · live 10 Nov · n=1,501
PythonKubernetesDockerPyTorchLLMs

About Plenful

Plenful is on a mission to transform healthcare operations from the inside out. Fresh off our $50M Series B and backed by Notable Capital, Bessemer Venture Partners, TQ Ventures, Susa/Kivu Ventures, and other leading investors, we’re building the category-defining AI automation platform that healthcare teams rely on to operate smarter, faster, and more efficiently. Our technology empowers healthcare operators across hospital and health systems, pharmacies and payors to eliminate manual work, reduce administrative burden, and improve compliance, all while unlocking critical revenue to fund programs for their in-need patient populations.

Built by healthcare operators for healthcare operators, Plenful is driven by a deep understanding of the challenges facing today’s care teams. We’re passionate about equipping healthcare workers with world-class tools that deliver real, measurable impact, and we’re proud to serve 100+ leading health systems, pharmacies, and healthcare organizations across the country. If you’re excited to help shape the future of healthcare, we’d love to meet you. Apply now to join our growing team.

About the role

Healthcare's back office still runs on faxes, PDFs and phone calls. AI can take that work off people's plates, but only if it is accurate enough to trust with patient and financial data.

At Plenful, we build agents and models that do that work in production, with people in the loop wherever judgment matters. As a Senior Machine Learning Engineer, you own the pieces that make those systems reliable: the agents, the models behind them, and the data and evaluation loop that improves both every week.

What you'll do

You ship agents that do real work

Design, build and run production agents that use tools, retrieval and multi-step reasoning to finish healthcare workflows end to end.

Build the orchestration, tracing and failure recovery that keep agents dependable when inputs are messy.

Decide when a problem needs an agent, a model or a deterministic rule, and route low-confidence cases to a person.

You make models better, not just call them

Fine-tune and post-train LLMs and vision-language models on healthcare tasks, using methods like supervised fine-tuning, preference optimization and distillation.

Choose between prompting, retrieval and fine-tuning for each problem, and prove the choice with data.

Balance quality, latency and cost when you serve models.

You own the loop that makes it all improve

Build and version datasets: labeled sets, golden sets and synthetic data drawn from production signal.

Write evals that catch regressions before customers do: automated graders, LLM-as-judge calibrated against human labels, and regression suites that run in CI.

Instrument production with tracing, drift detection and failure taxonomies, then feed what you learn back into training data.

Keep releases reproducible with solid MLOps: Docker, Kubernetes, MLflow or equivalent, and CI/CD.

You handle patient data with care

Use the minimum data necessary, and de-identified or synthetic data wherever it does the job.

Follow HIPAA and Plenful's security and AI usage practices in how you build, test and log.

What we're looking for

5+ years building and shipping software or ML systems, including 2+ years with LLM-based systems in production.

Strong Python, plus PyTorch and Hugging Face Transformers.

Hands-on agent experience with a framework like LangGraph, and with RAG and vector search (for example Pinecone).

You have fine-tuned an LLM or VLM and can explain what improved and how you measured it.

You have built an evaluation harness and know why accuracy alone misleads and how to calibrate an LLM judge.

Comfort with large-scale datasets, databases and data pipelines.

Experience with traditional ML, and the judgment to know when a simpler model beats an LLM.

You stay current, and you can show it

You use the newest models and coding agents every week, form opinions, and test them on real problems.

You go from idea to working prototype in hours, then bring back what works.

Source · PlenfulFirst seen 7 NovOriginal ↗