Skip to content
Linkup

Senior Data Engineer

NYC (NY), San Francisco (CA) or Paris (FR)United States
Senior · FullTime · Tech
POSTED 6 NOV 2025VERIFIED 4H AGO
Apply Ask
Pay · market
$184k–$225k
p25–p75 · n=33
Open for
362d
since 6 Nov 2025
Hiring · 30d
14
0 net · open roles
PythonJavaRustSparkSQLLLMsDistributed systems

About the role

We’re looking for a top-tier Senior Data Engineer to join our tech team and work hand-in-hand with our CTO, Denis Charrier, and the rest of the tech team.

Your core responsibilities will be to:

Build and operate large-scale, high-throughput data pipelines powering AI-ready web search

Design and maintain distributed ETL / ELT workflows for web indexing, embeddings, and analytics

Develop and optimize data ingestion and transformation systems across structured and unstructured sources

Manage and scale data storage layers (SQL, NoSQL, and object stores) for performance and reliability

Participate in architecture discussions and contribute to system design for data infrastructure

Collaborate with ML and backend teams to deliver high-quality, real-time data for ranking and retrieval

Write clean, maintainable code and participate in code reviews

Requirements

You’re a great match if you:

Are excited to help build Google for AI agents — and believe in Linkup’s mission

Have strong experience in data engineering or backend development (3y minimum)

Understand distributed systems, data modeling, and streaming architectures

Care about data quality, observability, and system reliability

Enjoy debugging tough pipeline issues and optimizing for latency or throughput

Are curious about AI infrastructure, indexing systems, and retrieval-augmented generation (RAG)

Thrive in a fast-paced, high-ownership startup environment

Example Projects

Stream and transform billions of web facts per day under strict freshness SLAs (< 5 min)

Build a real-time data lake to serve embeddings, metadata, and ranking features to LLMs

Design fault-tolerant pipelines for continuous crawling, deduplication, and enrichment

Develop internal tools to monitor and profile data flows across terabytes of web-scale content

Our Stack

Python, Java, Rust, Apache Storm / StormCrawler, Spark, Databricks, Delta Lake, Polars, Panda, NATS, vLLM

Details

The ideal candidate will play a central role in our engineering team, partnering closely with the founders to spearhead groundbreaking products. Your expertise will shape the future of AI‑powered applications and bring our vision to life.

We offer a flexible remote‑work policy- see the details here.

Join us and leverage your expertise to push the boundaries of AI!

About Linkup

Our Vision

We believe in a future of AI agents and the agentic web. These digital entities can create more value for humanity than we ever could alone, but they depend on the internet to operate, collaborate, take action, and gather information.

AI agents need web search. To perform well, they require information that is current, reliable, and context‑specific—not the diffuse, steadily aging knowledge frozen at their last training cut‑off.

Modern web search is built for humans, not AIs. Instead of trusted facts, it serves links, ads, and click‑bait. People want visually engaging pages; AI systems need structured truth. An AI can absorb oceans of data, while human attention barely skims the surface. Humans think visually and intuitively; AI reasons in latent space.

Web 2.0 is sunsetting. The deck is being reshuffled, and the Bing‑Google search oligopoly is crumbling. Indexing ever more pages is no longer the goal; semantically organizing facts for AI systems is. In the coming agentic web, Google’s ad‑driven model has no natural home.

Search for AI must be rebuilt from the ground up. We are reconstructing the web as a rigorously structured knowledge layer, mapping every concept, entity, and claim into a coherent semantic graph. This foundation delivers verified facts and rich context to AI instantly, unlocking faster reasoning, higher accuracy, and radically more useful answers for everyone.

Humans search Google; AI searches Linkup.

Our Mission

Reality never stands still, and neither should intelligence. Linkup reconnects language models to a living stream of verified facts, ensuring AIs remain as current and insightful as the world they serve.

Our mission is to deliver the world’s freshest, most trusted knowledge to AIs.

Source · LinkupFirst seen 2 NovOriginal ↗