About CertifyOS
CertifyOS is building the data infrastructure that powers modern healthcare.
Today, healthcare organizations rely on fragmented and outdated provider data. This creates unnecessary administrative work, regulatory risk, and higher costs across the system. We’re solving that problem.
Our API-first platform automates provider licensing, enrollment, credentialing, and network monitoring by connecting directly to hundreds of primary data sources. We help healthcare organizations maintain accurate, compliant, and reliable provider networks at scale.
Our vision is simple: One API. One provider ID. Frictionless provider data.
We’re backed by leading investors and built by a team with deep experience in provider data systems. At CertifyOS, we value authenticity, accountability, collaboration, results, and openness to feedback. We’re building a high-ownership team focused on solving real infrastructure problems that impact millions of patients.
About the Role
We are looking for an AI-first Software Development Engineer in Test (SDET) to help us build reliable, scalable, and high-quality software.
This role goes beyond traditional QA and test automation. You will leverage AI-assisted engineering and agentic workflows to accelerate test development, improve test coverage, automate quality checks, and identify performance and scalability issues.
You will work closely with developers, product managers, and engineering leaders to embed quality throughout the software development lifecycle.
We expect you to think like a software engineer, automate like an SDET, and use AI as a force multiplier.
Key Responsibilities
1. AI-First Quality Engineering
Adopt AI-assisted and agentic approaches across the testing lifecycle.
Use AI coding agents to generate, execute, debug, and maintain automated tests.
Build AI-assisted workflows for test case generation from product specifications and acceptance criteria.
Explore agentic testing approaches that can independently execute workflows, identify failures, and report defects.
Use AI to analyse test failures, identify patterns, and suggest potential root causes.
Continuously identify opportunities to reduce manual effort through AI and automation.
2. Test Automation
Build and maintain scalable automation frameworks for UI, API, integration, and end-to-end testing.
Develop reusable test components and automation libraries.
Automate critical business workflows and regression suites.
Integrate automated testing into CI/CD pipelines.
Use Playwright, Cypress, Selenium, or equivalent frameworks.
3. Performance & Load Testing
Design and execute load, stress, spike, and endurance tests.
Simulate real-world traffic, concurrent users, and high-volume API requests.
Establish performance benchmarks and service-level objectives.
Identify bottlenecks across APIs, databases, microservices, and infrastructure.
Use tools such as k6, JMeter, Locust, or Gatling.
Analyse latency, throughput, resource utilisation, and error rates.
Work with developers to identify and resolve performance bottlenecks.
4. Scalability & Reliability Engineering
Validate application behaviour as traffic, data volume, and workloads increase.
Identify scalability limitations across distributed systems.
Test asynchronous workflows, queues, event processing, retries, and failure recovery.
Evaluate database performance and query efficiency under load.
Identify resource constraints and potential points of failure.
Contribute to capacity planning and reliability improvements.
5. Engineering Collaboration
Work with developers and product managers to identify quality risks early.
Participate in technical design and code reviews.
Define quality gates and automation standards.
Build a culture where quality is everyone’s responsibility.
Required Skills & Experience
3–6 years of experience in software testing and automation engineering.
Strong programming skills in Python, Java, or JavaScript/TypeScript.
Hands-on experience with Playwright, Cypress, or Selenium.
Strong API automation and backend testing experience.