With Heal’s agent acting as our dedicated QA team, we have stable, reliable Playwright tests that just work."

Seb Duc, CTO and co-founder of Bastion

A growing product

When Seb and his team started building Bastion, they were spending a lot of time on manual QA. As the platform grew, it got time-consuming. “Testing only a small part of the product was taking half a day of 2 people each week”, Seb remembers. “With time, we started doing it less and less well. Humans are not machines, we’re bad at doing repetitive tasks”.

After a while, they decided to stop and see if they could live without a dedicated QA process. This seemed possible because Bastion’s virtual CISOs are always on the platform and provide a tight feedback loop. But after encountering several P0 bugs in production that impacted users, they decided to revisit.

QA for small and nimble teams

Seb wanted the team to stay small and nimble. Ideally, they could automate the problem away instead of hiring, managing, and scaling a dedicated QA team. But test automation was painful to deploy:

"We tried writing our own Playwright tests, but it quickly turned into a maintenance nightmare. With Heal’s agent acting as our dedicated QA team, we have stable, reliable Playwright tests that just work."

Seb Duc, CTO and co-founder of Bastion

In the age of the 10-person unicorn, modern teams are small and nimble. They have to move fast to keep up with fast-changing user needs, while holding a high-quality bar to engage customers who are more and more sophisticated about vendor management. Quality is a more important differentiator than ever.

So what’s the right approach for QA? Manual QA is slow and doesn’t scale unless you hire and manage a dedicated team. And automation is tricky to deploy, time-consuming to maintain, and flaky. Fast, efficient automated tests with a high signal/noise ratio are needed to ship fast and confidently.

1. ❌ Scale a QA team
2. ❌ Noisy end-to-end tests
3. ✔️ Use Heal.dev

Rolling out Heal

Heal’s agent automates, runs, and maintains end-to-end tests for you so you don’t ever have to think about testing. The setup is simple: Bastion posts high-level descriptions of its test scenarios in Slack, and Heal automates them, with expert validation from Heal’s QA engineers to make sure the tests are perfectly designed.

Maintenance is completely automated. “When a test breaks because the UI changes or there’s a flake, we have nothing to do” says Seb. Heal’s agent fixes the tests automatically, usually in a few minutes.

And when there’s a bug, Heal’s agent automatically investigates and writes a bug report.

Less P0 in production. More confidence.

“On the scope of things tested by heal, which is our user-facing platform, critical bugs decreased by 30% in production”.

Seb Duc, CTO and co-founder of Bastion

“What I like is when we fix something, we can run the test and just verify it passes without having to check on staging. I click a button, I get an answer. It saves me time, and avoids inefficient context switching.”