Analyzing the results

Hi,

My unit test takes 1 minute to complete.

For load test run duration I have given as 2 minutes i.e.My unit test runs twice during load test.

I am using step load pattern.

I am running the load test for 20 users.

In avg column the results are showing as

User load: 10

Test/sec : 0.46

Avg test time : 13.3

By seeing above results

Response time for single user is 13.3 is it right? Or because my unit ran twice during load test, for single user response time is 13.3/2 =6.65

1. For single user I want know the response time in the above case. Please let me know is it 13.3 or 6.65 or any other answer?

2. What is the through put for single user?

3 .suppose customer requirements are that application should support 25 users.

Can I use step load option with 25 users? Because when user runs the load test with 25 users using the step load option we will see the results of avg column. Avg column may give user load as 10 not 25. like in the above case I have given the details of user load,test/sec and avg test time.

Can I user step load option for this scenario or not? Or for this requirement I should use constant load option? Pls let me know which option I should select?

  1. I am running the same load test on every day against the same server. All are same like number of users and test time and load pattern as step load.

But one day load test fails for 10 users and other day load test fails for 20 users.

Results are not at all matching? I am using VSTS load test for the first time?

Why the results are not consistent?

Thanks,

Shankar

[4867 byte] By [ShankarK] at [2008-1-3]
# 1

The avg test time is the amount of time for a test to run. So in your case it is 13.3 seconds. You said that your test runs twice during the 2 minute test. Did you set the think time between test iterations to some thing greater than 0. With a 13.3 second test time, you should have had more than 2 total tests executed.

You can use 25 users with the step load. The avg column is not going to show 25, because the test is stepping to 25. So if the starting user load is 5 and the max is 25, the average will be in the middle.

What do you mean it failed for 10 users then 20. Did all the tests fail? What kind of errors appeared on the error tab?

slumleyMSFT at 2007-9-25 > top of Msdn Tech,Visual Studio Team System,Visual Studio Team System - Web and Load Testing...
# 2
When the results such as avg. test time are calculated, does Orcas automatically subtract think times if you included them in the test from the calculations so that the test does not appear to be longer because of think times?
jonathan_lee3 at 2007-9-25 > top of Msdn Tech,Visual Studio Team System,Visual Studio Team System - Web and Load Testing...

Visual Studio Team System

Site Classified