Testing4success.com Forums

  • May 18, 2012, 04:43:35 AM
  • Welcome, Guest
Please login or register.

Login with username, password and session length
Advanced search  

News:

ISTQB Training Sale: You are not allowed to view links. Register or Login

Author Topic: Always at the end?  (Read 186 times)

Kelly_Ki

  • Newbie
  • *
  • Posts: 12
Always at the end?
« on: November 18, 2011, 11:59:02 AM »

So, is system testing always at the end of a project. Is there anything that can be done before-hand?

Kelly
Logged

JennyK

  • Newbie
  • *
  • Posts: 23
Re: Always at the end?
« Reply #1 on: November 21, 2011, 07:37:39 AM »

Typically yes; as you need a certain degree of functionality in order to run a system test.
Logged

7cats

  • Global Moderator
  • Newbie
  • *****
  • Posts: 30
Re: Always at the end?
« Reply #2 on: November 23, 2011, 09:51:04 AM »

System test requires that the test subject be 'complete' or at least 'usable'.  You are using a 'real' environment, which can be adversely affected if there are significant problems with the item to be tested.  Thus 'at the end' is usually the most practical and most effective place for system testing.

Of course, there are times when some degree of overlap with earlier steps in the process is deemed necessary.  In these cases, it is best if the test systems are isolated from anything else, so if they are 'damaged' by the subject of test, nobody else is affected.  Furthermore, be prepared for 'duplication of work' as multiple phases end up being affected by the same problem, and more 'retesting' of the problem areas.  The better the approved agreement between the various parties, the less contention there is likely to be when things 'bog down'.

Note that System Test is not really the 'very last step'.  There is generally some form of 'customer acceptance' or 'usability' test.  This often is done by customers (early ship program or beta test) before general availability, or formally or informally after GA.  In this case where no such testing will be done pre-GA, the smart system tester will include some of this testing in their system test.

Thanks,
John
Logged

DaveT

  • Newbie
  • *
  • Posts: 38
Re: Always at the end?
« Reply #3 on: November 24, 2011, 12:32:27 PM »

In my experience system testing can get squeezed because it occurs later on in the project. I wish more effort was made in planning the system testing to get the most out of it.

Gaz
Logged

7cats

  • Global Moderator
  • Newbie
  • *****
  • Posts: 30
Re: Always at the end?
« Reply #4 on: November 24, 2011, 09:31:24 PM »

Of course it can.  If one or more previous steps 'runs over', then the System test either starts late or starts without every thing needed (via an approved Deviation from the Entry Criteria).  Changing the System test end date is difficult at best.  So when planning the test, you need to be aware of this. 

I will tell you how long it will really take you to test anything: longer than you think it will.

Therefore, we always planned for the likely 'worst case scenario' when determining our initial test length estimates.  And we never planned to spend more time in each week than a normal  (40 hour) work week during the test.  This gave us 2 additional shifts per day and the weekends to compensate for things worse than the worst case scenario (such as earlier steps significantly missing their dates).  The people we saw who used planned overtime for their tests very often came to grief as they did not have enough days to compensate for the unexpected, and the testers lost efficiency as they got worn out. 

John
Logged
 

25% Off ISTQB Distance-Learning Products - Click Here