Show HN: Flakytest.dev – Improve your flaky test handling process
flakytest.devI made flakytest.dev because I was frustrated with how teams usually handle CI failures due to flaky test (in my experience it's often a manual process).
The core feature is a one-click way to mute a randomly failing test. Muting is different than skipping a test because a muted test will still run on CI, but it won't fail the entire build if it fails. Keeping a flaky test running in your CI is usually valuable so that you gather more data about it and that your error logs stay relevant.
It only works with pytest for now, but I'll add support for other test frameworks if there is any interest!
I did my thesis in flaky tests, it's such a neglected area in ci/cd. Good too see people are doing something against it.
I'd love to read your thesis! If it's possible please send a link :)
You can find it if you browse: "Non-deterministic tests and where to find them". I def think we should connect! Just sent ya a request on LinkedIn :)