Software Engineer - AI Tooling
- Opened · 30d
- +4,760
- Closed · 30d
- −2,668
- Opened · 7d
- +3,92010% of open
- All software engineering
- 75,361open
Accountabilities
Design, develop, and continuously improve AI-powered developer tools, including MCP servers, intelligent agents, agent skills, and dashboard assistants.
Ensure new products and features are accessible to AI agents from launch by developing the necessary tools, skills, integrations, and evaluation frameworks.
Explore emerging AI technologies and agent architectures, rapidly prototype new solutions, assess their effectiveness, and collaborate with the team to determine which innovations are suitable for production.
Establish and promote an evaluation-first engineering culture by developing evaluation frameworks, instrumentation, and feedback loops to measure AI tool quality and effectiveness.
Benchmark AI-powered tools against no-tool baselines, monitor performance, and define quality indicators and release criteria to prevent regressions.
Analyse how developers and AI agents interact with existing tools and translate usage insights into improvements to interfaces, documentation, and overall functionality.
Design and optimise how technical documentation and product knowledge are structured and exposed to AI agents, measuring their effectiveness and accessibility.
Develop reusable patterns and tools that enable customers to integrate AI capabilities into their own applications, including MCP integrations with Edge Functions, vector embeddings, and AI agents running on Edge Functions.
Enable cross-functional engineering teams to contribute to AI capabilities by providing clear contribution guidelines, templates, documentation, and review processes.
Centralise shared AI logic and reusable components to encourage consistency and reduce duplicated development efforts across teams.
Ensure production readiness through comprehensive testing, benchmarking, stress testing, and continuous reliability improvements.
Collaborate with AI Tooling Infrastructure engineers on service hosting, authentication, scalability, and operational reliability.
Work closely with Documentation, CLI, Frontend, SDK, and other engineering teams to deliver a seamless and consistent developer experience.
Stay informed about developments in the AI ecosystem and identify opportunities to incorporate relevant technologies and practices into the platform.
Requirements
At least 5 years of professional software engineering experience.
Strong proficiency in TypeScript and extensive knowledge of the JavaScript ecosystem, including npm, ES modules, bundlers, and compatibility considerations.
Deep familiarity with the AI ecosystem, including current tools, agent architectures, development patterns, and their practical trade-offs.
Ability to distinguish sustainable and effective AI engineering approaches from short-lived trends or unnecessary complexity.
Previous experience building developer tools, product interfaces, or platform components used by other engineers.
Experience designing, implementing, or working with evaluation frameworks to measure AI quality, reliability, and task success.
Understanding of evaluation fundamentals, including baselines, performance variance, cost considerations, and measurable quality improvements.
Strong technical judgment when identifying opportunities to use AI effectively while avoiding fragile, unnecessary, or overly complex solutions.
Solid testing practices and experience validating software reliability under real-world conditions.
Good knowledge of PostgreSQL and relational database principles.
Excellent written communication skills and the ability to collaborate effectively across engineering, product, and documentation teams.
Comfortable working in asynchronous, globally distributed teams and managing priorities independently.
Ability to navigate ambiguity, adapt to rapidly evolving technologies, and deliver high-quality solutions in a fast-paced environment.
Additional experience that would be an advantage:
Experience working with vector databases, embeddings, and semantic search technologies, particularly pgvector.
Previous experience shipping customer-facing AI features, intelligent assistants, or autonomous agents.
How Jobgether works
We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.
We appreciate your interest and wish you the best!
Why Apply Through Jobgether?
Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.
#LI-CL1