Cet article est également disponible en français.
Far be it from me to disavow the usefulness of test automation. I am a strong advocate of test automation. Yet, too often the topic is discussed from the wrong angle. Here are some examples!
A team seeks my advices as a Test Facilitator. They don’t control regressions. They come to me so that I can help them to define a test automation strategy.
What do I recommend to them?
After having discussed with them to understand the situation, my recommendations are mostly about processes:
… and only when they will have taken care of these essential problems, will we start talking about test automation.
Ah! I have heard this sentence so many times…
Come on we really gotta automate these tests! All our problems will be gone after that.
Indeed, yes, automating these non-regression tests would be a wonderful idea. By the way, this is such a good idea that I’m wondering: why isn’t it done already?
Still I’m saddened to say you that, no, automating tests won’t magically solve all of your problems.
Even with a great non-regression test harness, you’ll have to keep challenging the product.
Test automation is awesome. But it’s no silver bullet. Test automation has not marked the demise of manual testing. Even worse, with test automation you are still required to think, to set up a strategy, to use the product.
Hell yes! How boring processes are. Nobody cares. Why are we bothering?
Yet processes — and following them! — are key to a well running team. As I like to put it:
Agile requires to be extremely rigorous.
And when I’m talking about processes, I am not expecting complex decision diagrams lost into the corporate intranet. No, processes can be simple, visual, understandable… Most of all, it must fit with how the team works.
Let’s keep it brief. People like talking to me about test automation because they think it is a silver bullet.
Unfortunately, it isn’t. Well, “unsurprisingly” would have been a better choice. You should know better by now: silver bullets simply don’t exist.
What’s a good automated test?
You’re not even close to know if you don’t already know what makes a good manual test.
Automating tests cost so much! Where should we start?
Well, why not starting with the most critical scenarios… I’m guessing you know them, right?
We’re scared of regressions! We have to automate tests.
Why are you scared of regressions?
If you don’t trust your non-regression test scenarios, automating them will do no good. Have you defined those test scenarios?
If you are not running the non-regression test scenarios by hand, then obviously regressions are not that a big deal. Are you sure you’re scared?
We don’t have time to automate the tests!
If you were wasting your time running the non-regression test scenarios by hand, you would find the time. Calculating the return on investment would be trivial and straightforward.
Thus, the situation doesn’t look that bad…
Overall, this is what happens:
People ask me guidance about quality and non-regression, people want to be told about test automation, my answer is about process and rigor.
Just start by reviewing thoroughly your processes, and follow them strictly. You can get incredibly far with just that! Take for instance this team that I have helped:
Please clap 👏 and share the article! It is because of you that I put my heart and soul into writing.
And follow me on my blog to be notified when I publish new articles!
Thank you so much!