Company Description

MedTrainer is the only all-in-one compliance platform purpose-built for healthcare organizations, by healthcare professionals. For over 13 years, we have helped healthcare teams remain audit-ready and confident in their regulatory compliance through continuous innovation and deep industry expertise.

Our cloud-based platform unifies learning management, credentialing, and compliance into a single intelligent system designed to simplify complex healthcare operations. Powered by automation and AI-driven workflows, MedTrainer enables organizations to onboard faster, streamline processes, and scale efficiently while maintaining the highest standards of compliance and workforce readiness.

We are looking for people who are curious, collaborative, and excited to build reliable technology that supports a mission-driven healthcare platform. Be part of a great engineering team that constantly challenges its status quo to build the best product in the industry alongside our Product and DevOps teams.

Job Description

Looking for a Senior Software Engineer - AI to design, build, and operate LLM-powered product features and internal AI tooling that drive real business value for healthcare organizations. You will take AI capabilities from prototype to production, working with LLM APIs, retrieval-augmented generation (RAG), embeddings and vector databases, and agentic workflows, while making sure every solution is measurable, reliable, cost-efficient, secure, and HIPAA-aware. This role collaborates closely with Product, DevOps, and Data/IT teams, breaks down ambiguous problems into actionable tasks with minimal oversight, and helps establish AI engineering best practices, evaluation standards, and responsible AI guidelines across the organization.

Responsibilities

Build AI Product Features: Design, develop, and ship LLM-powered features (assistants, intelligent search, summarization, content and document generation) into the MedTrainer platform, from prototype to production.
RAG and Retrieval: Build and tune retrieval-augmented generation pipelines, including document ingestion, chunking, embeddings, vector search, re-ranking, and grounded answers with citations.
Agents and Internal AI Tooling: Create agents, tool/function-calling workflows, and internal AI tools that automate processes and boost productivity across Engineering, Product, and operations.
Evaluation and Quality: Own prompt engineering and evaluation by building eval datasets, automated and LLM-as-judge evals, and regression tests that gate releases and prove quality improvements.
Production Engineering: Develop Python services and APIs that integrate with our existing platform (PHP/Node), deployed with Docker, Kubernetes, and GitHub Actions on Azure/AWS, with observability for quality, latency, and cost.
Security, Privacy, and Responsible AI: Apply HIPAA-aware data handling, PHI/PII minimization and redaction, prompt-injection defenses, guardrails, and human-in-the-loop controls where needed.
Collaboration and Culture: Partner with Product, DevOps, and Data/IT to define success metrics, communicate progress and trade-offs clearly, and share AI knowledge and best practices across the team.

Qualifications

Education: Bachelor’s degree in Computer Science, an equivalent degree, or equivalent professional experience.
Professional Experience: 4+ years of software engineering experience, including at least 1 year building and operating LLM/ML-powered features in production.
Methodological Background: Proven experience working within structured Agile/Scrum development environments.
Language Proficiency: Advanced English skills are considered a plus.

Essential Technologies and/or Skills

LLMs and APIs: Hands-on experience with LLM APIs such as OpenAI, Anthropic, and/or Azure OpenAI, including structured outputs, streaming, and function/tool calling.
RAG, Embeddings, and Vector Databases: Practical experience with embeddings, vector databases (pgvector, Pinecone, Qdrant, Azure AI Search, or similar), and retrieval strategies such as hybrid search and re-ranking.