Agile Testing versus Waterfall Test Phases

Agile Testing - Waterfall Phases.I have recently been asked by a tester how agile testing compares to the various test phases in more traditional, waterfall development projects.

For instance, after the code has been unit tested, are there several testing phases, such as system, integration and regression testing?

Although these layers of testing do exist in agile projects, agile testing is integrated throughout the lifecycle, with each feature being fully tested as it’s developed, rather than doing most testing at the end of all the development.

Here’s how traditional test phases typically fit in with an agile testing approach:

  • Unit testing is still completed by developers as usual, but ideally there’s a much stronger emphasis on automated testing at the code/unit level.
  • In eXtreme Programming (XP), there is also a strong emphasis on test driven development, which is the practice of writing tests before writing code. This can start simply with tests (or ‘confirmations’) being identified when a ‘user story‘ is written, and can go as far as actually writing automated unit tests before writing any code.
  • System testing and integration testing are rolled together. As there is at least a daily build, and ideally continuous integration, features can be tested as they are developed, in an integrated environment. As per waterfall, this stage of testing is ideally carried out by professional testers, as we all know developers can’t test for toffee! Importantly, though, each feature is tested as it’s developed, not at the end of the Sprint or iteration, and certainly not at the end of the project.
  • Towards the end of each sprint, when all features for the iteration have been completed (i.e. developed and tested in an integrated environment), there needs to be time for a short regression test before releasing the software. Regression testing should be short because automated, test driven development, with features tested continuously in an integrated environment, should not result in many surprises. Hopefully it should be more like a ‘road test’.
  • Finally, on a very large project, where a release must practically span multiple sprints to be of any value, a ‘stabilisation’ sprint may be worthwhile to make sure everything is okay before release. This should, however, be a short duration and the need for a stabilisation sprint should be avoided if at all possible, by trying to deliver releasable quality in each and every sprint along the way. If it is required, this sprint should be all about reducing any defects prior to launch, and the scope of development should at that time be frozen.

That’s a very quick summary of how traditional test phases fit in with an agile testing approach. In many ways it’s common sense, although it’s not always easy!


Photo by BaylorBear78

4 Responses to “Agile Testing versus Waterfall Test Phases”

  1. David says:

    I agree with all the statements of the article.
    Nevertheless, we're facing some issues using them.
    In sprints of 2 weeks, each user story tend to be completed at the end of the sprint. Then, our tester verify the user story.
    But the defects detected are piling up at the end of the sprint and we need to plan debugging time at the start of the next Sprint.
    Any idea how to tackle this and close all user stories (debugging included) on the Sprint?
    Thank you

  2. coneyhallblogger says:

    Hi David – yes it is a problem that all testers encounter in a sprint or any other form of iteration. Ideally the time needed for defects should form part of the sprint planning. Some teams use a finger in the wind guestimate of 15% of the sprint dedicated to bug fixing. This can be refined as metrics are kept over the forthcoming iterations.

  3. Lily says:

    This article is very informative to me.
    I am a tester for a team using Agile. It requires me to know how the tester do in the Agile team.

    I met a problem that some of testing tasks have been postponed into next iteration due to some certain reasons, such as the env is not stable, the development is impeded.

    Do you have some suggestion on how we tester do with this situation and avoid it happenning so often?

    Thanks, Lily

  4. Kelly Waters says:

    Hi Lily,

    First of all, I have found in my experience that the problem you describe is very common – in fact most teams have this problem when they start using agile methods and it can take quite a while to overcome. Hopefully that should give you some reassurance.

    However, it is important to identify and understand the underlying causes of this and take actions to solve them. The result if you can will mean completing testing earlier and ultimately being able to produce working software faster, so it’s usually well worthwhile. Even if you’re not planning to release the software live, having truly measurable progress and quality in the form of tested software, rather than piles of untested software, is of course a better measure of where you’re really at in your project.

    So my advice to you as a team is to look for the underlying reasons that it wasn’t possible to complete some working (tested) software inside your iteration and start to take action actions to remedy those, resisting the temptation to just make your iterations longer. Even if it takes some time to remedy all the causes of this symptom, the point is that your short iterations are highlighting problems and you should build actions into subsequent iterations to incrementally start tackling them.

    Anyway, I hope that helps, and good luck!


Leave a Reply

What is 2 + 6 ?
Please leave these two fields as-is:
Please do this simple sum so I know you are human:)

There are 101 ways to approach anything.
To find the best way, sometimes you need expert help

What People Say

“Kelly revolutionised the way our digital department operated. A true advocate of agile principles, he quickly improved internal communication within our teams and our internal clients by aligning our business and creating a much enhanced sense of transparency in the decisions the business was making. Kelly also introduced a higher sense of empowerment to the development teams...”


“Kelly’s a leading program director with the ability to take charge from day one and keep strong momentum at both a program and project level driving prioritisation, resourcing and budgeting agendas. Kelly operates with an easy-going style and possesses a strong facilitation skill set. From my 5 months experience working with Kelly, I would recommend Kelly to program manage large scale, complex, cross company change programs both from a business and IT perspective.”


“Kelly is an extremely talented and visionary leader. As such he manages to inspire all around him to achieve their best. He is passionate about agile and has a wealth of experience to bring to bear in this area. If you're 'lucky' he might even tell you all about his agile blog. Above all this, Kelly is great fun to work with. He is always relaxed and never gets stressed - and trust me, he had plenty of opportunity here! If you get the chance to work with Kelly, don't pass it up.”


“Kelly is an Agile heavy-weight. He came in to assess my multi-million $ Agile development program which wasn’t delivering the right throughput. He interviewed most of the team and made some key recommendations that, when implemented, showed immediate results. I couldn’t ask for more than that except he’s a really nice guy as well.”


“Kelly and I worked together on a very large project trying to secure a new Insurer client. Kelly had fantastic commercial awareness as well as his technical expertise. Without him I would never had secured this client so I owe a lot to him. He is also a really great guy!”


“Kelly came to the department and has really made a huge impact on how the department communicates, collaborates and generally gets things done. We were already developing in an agile way, but Kelly has brought us even more into alignment with agile and scrum best practices, being eager to share information and willing to work with us to change our processes rather than dictate how things must be done. He is highly knowledgable about agile development (as his active blog proves) but his blog won't show what a friendly and knowledgeable guy he is. I highly recommend Kelly to anyone looking for a CTO or a seminar on agile/scrum practices - you won't be disappointed!”


“Kelly was a great colleague to work with - highly competent, trustworthy and generally a nice bloke.”


“Kelly was engaged as a Program Director on a complex business and technology transformation program for Suncorp Commercial Insurance. Kelly drew on his key capabilities and depth of experience to bring together disparate parties in a harmonised way, ensuring the initiate and concept phases of the program were understood and well formulated. Excellent outcome in a very short time frame. ”


“I worked with Kelly on many projects at IPC and I was always impressed with his approach to all of them, always ensuring the most commercially viable route was taken. He is great at managing relationships and it was always a pleasure working with him.”


“I worked with Kelly whilst at Thoughtworks and found him to be a most inspiring individual, his common-sense approach coupled with a deep understanding of Agile and business makes him an invaluable asset to any organisation. I can't recommend Kelly enough.”


“Kelly was a brilliant CTO and a great support to me in the time we worked together. I owe Kelly a great deal in terms of direction and how to get things done under sometimes difficult circumstances. Thanks Kelly.”