Skip to content
Lilt Corporate

Technical Project Manager

USARemote · United States
Manager · FullTime · Production
POSTED 18 SEPT
Apply Ask
Role
52 days opentrue age
Posted 18 Sept
Payats field
$104k–163kposted
▲ +1% vs market median $133k
$85k$170k
Market p25–p75
$85k–$170k
United States · n=7510 · 365d to 6 Nov
CompanyLilt Corporate →
23open roles
Opened · 30d
+0
Closed · 30d
−0
30d window
Market
73,301open · Manager Other
Opened · 7d
+5,7398% of open
All other
624,532open
All tracked boards · live 10 Nov · n=73,301
SQLLLMs

About LILT

AI is changing how the world communicates — and LILT is leading that transformation.

We're on a mission to make the world's information accessible to everyone, regardless of the language they speak. We use cutting-edge AI, machine translation, and human-in-the-loop expertise to translate content faster, more accurately, and more cost-effectively without compromising on brand, voice, or quality.

At LILT, we empower our teammates with leading tools, global collaboration, and growth opportunities to do their best work. Our company virtues—Work together, win together; Find a way or make one; Dance in the customer's shoes; Quicker than they expect; Quality is Job 1—guide everything we do. We are trusted by Intel Corporation, Canva, the United States Department of Defense, the United States Air Force, ASICS, and hundreds of global Enterprises. Backed by Sequoia, Intel Capital, and Redpoint, we’re building a category-defining company in a $50B+ global translation market being redefined by AI.

Technical Project Manager — Applied AI

We are looking for a Technical Project Manager to join our Applied AI team and lead large-scale multilingual data collection, human-in-the-loop workflows, and Large Language Model (LLM) evaluation initiatives. You will work with AI specialists, engineering teams, specialized Subject Matter Experts (SMEs), and data operations teams to translate technical AI requirements into high-throughput data workflows, hybrid evaluation pipelines, and measurable delivery plans.

This role combines technical project management with hands-on data analysis, unit economics optimization, and a strong operational understanding of modern LLM training and evaluation processes.

Key Responsibilities

Technical Project Delivery

Manage Applied AI data collection and evaluation projects from technical scoping through validation, delivery, and retrospective review. through implementation, validation, delivery, and retrospective review.

Translate technical AI requirements into structured data specifications, domain-specific annotation requirements, evaluation plans, and acceptance criteria.

Manage timelines and throughput velocity, dependencies, delivery risks, and technical blockers across Applied AI, engineering, and operations stakeholders.

Coordinate data collection and annotation for supervised fine-tuning (SFT), preference data used in reinforcement learning from human feedback (RLHF), and model evaluation.

Data Workflows & Evaluation

Partner with engineering teams to define and validate data workflows, including ingestion, annotation tooling, systems integrations, quality checks, data generation pipelines, and delivery.

Operationalize hybrid evaluation methodologies, combining human review with automated evaluation tooling, and LLM-as-a-judge frameworks.

Coordinate requirements for data formats, schemas, metadata, annotation tools, and system integrations.

Coordinate requirements for data formats, schemas, metadata, annotation tooling, and automated quality checks.

Work with Applied AI specialists to operationalize evaluation methods, including human review, response ranking, and safety testing.

Investigate data, pipeline, or tooling issues and coordinate prompt resolution with technical owners.

Quality, Cost, & Performance

Use SQL and business intelligence tools to analyze throughput velocity, quality, unit economics, and supplier/delivery performance.

Define and monitor quality standards, including inter-annotator (IAA) agreement, gold-set performance, and dataset completeness.

Lead root-cause analysis on quality discrepancies, workflow bottlenecks, benchmark discrepancies, and quality edge cases.

Establish delivery validation checks and coordinate stakeholder acceptance of completed, accurate datasets, delivery targets, and evaluation results.

Stakeholder & Contributor Management

Translate complex technical requirements into actionable plans and clear instructions for global contributor teams, external vendors, and specialized domain SMEs and teams.

Source · Lilt CorporateFirst seen 7 NovOriginal ↗