Author Topic: Real or virtual  (Read 1869 times)

SimonKLP

  • Jr. Member
  • **
  • Posts: 52
Real or virtual
« on: March 18, 2012, 05:34:37 PM »
I often use VMs, I would love to know how much test coverage is actually missed by using them?

5% maybe?


7cats

  • Global Moderator
  • Jr. Member
  • *****
  • Posts: 78
Re: Real or virtual
« Reply #1 on: March 26, 2012, 11:49:16 PM »
A VM is a SIMULATION.  So you miss 100% of testing with real I/O (at least with the VMs I am used to), 100% of testing with real system resources and timing and load and interactions.

VM is absolutely great for initial testing, where you can afford to crash the system and can benefit from the additional debug tools some VMs provide.  But you need to eventually get the code onto a 'real' system to make sure it can make it in the 'real world'.

John

DaveT

  • Jr. Member
  • **
  • Posts: 56
Re: Real or virtual
« Reply #2 on: April 08, 2012, 07:53:18 PM »
Yes, I agree....Virtual machines are great for initial testing, but my company always insists on testing real machines prior to a product's release. It's common sense really :)

yi665

  • Newbie
  • *
  • Posts: 29
Re: Real or virtual
« Reply #3 on: July 17, 2012, 07:18:02 PM »
Yep, virtual machines for functional testing and real machines at the end (system testing etc.)

yi665

  • Newbie
  • *
  • Posts: 29
Re: Real or virtual
« Reply #4 on: November 16, 2012, 01:40:38 PM »
We aim to test 75% testing on VMs and 25% on real machines.

I think this balance works well for our software product at least.

Yi

7cats

  • Global Moderator
  • Jr. Member
  • *****
  • Posts: 78
Re: Real or virtual
« Reply #5 on: November 16, 2012, 01:57:12 PM »
If the 75% is early testing and 25% the final testing, that might be reasonable, depending on how 'good' (complete) that final 25% is.  If you are saying that 'all tests' are run on both VM and real systems, that would require significant attention to the planning of all tests, to avoid 'part' of the product from never getting tested on a real environment.

QA_Cathy

  • Newbie
  • *
  • Posts: 12
Re: Real or virtual
« Reply #6 on: March 11, 2013, 09:56:37 AM »
Virtual machines are a great way to test on a range of environments. But, yes , make sure a small proportion of testing is done on a few real machines.

Izzy_101

  • Newbie
  • *
  • Posts: 44
Re: Real or virtual
« Reply #7 on: November 28, 2013, 07:42:47 PM »
Interesting read!


Share via facebook Share via linkedin Share via twitter

  Subject / Started by Replies / Views Last post
xx
Real devices or Simulators

Started by SimonKLP

1 Replies
637 Views
Last post March 18, 2012, 05:41:32 PM
by SueJe
 

25% Off ISTQB Distance-Learning Products - Click Here