| Subhashini
(Moderator): This is Subhashini Simha (Community Co-ordinator
, Microsoft India ) , the moderator for this chat . Please welcome
Naveen KS (MVP) the expert for the chat today. Naveen K S holds an
Engineering Degree and is currently pursuing his M.Tech in Computer
Science. He also completed his MCAD.Net, MCP in SQL Server and Map
Objects (GIS) Certification. He is currently a Sr. Software Engineer
in Hewlett Packard-GDIC division of Microsoft Solutions Dot.NET practice
based in Bangalore, India. Naveen has vast experience in Requirements
gathering, use cases, UML, designing & development of business
& GIS applications using Microsoft technologies. His interest
includes OOAD, UML, design patterns, agile methods and mobile &
other business application developments using .Net. |
| Subhashini
(Moderator): Naveen manages a website [www.mstechcommunities
<http://www.mstechcommunities>]
and also manages a group whose interests are Designing, Architecture
& Management related to .Net applications. |
| Naveen is fascinated about
technology and its impact on business and loves to get involved in
talk that discusses on same. He loves to watch old Hollywood classic
& war movies, Sci-Fi & Action and is a great fan of Geoggery
Peck & Tom Cruise. His interest also includes playing computer
games, surfing the internet, reading about latest trends and technologies
in the market. He can be reached at ksnaveen@hotmail.com <mailto:ksnaveen@hotmail.com>. |
| Subhashini
(Moderator): This chat will last for one hour. During
this hour, our Expert will respond to as many questions as they can.
Please understand that there may be some questions we cannot respond
to due to lack of information or because the information is not yet
public. We encourage you to submit questions for our Experts. We ask
that you stay on topic for the duration of the chat. This helps the
Guests and Experts follow the conversation more easily. We invite
you to ask off topic questions after this chat is over, but not during |
| Subhashini
(Moderator): Today is a discussion on Performance
& Stress Testing using WAS & ACT tools |
| Subhashini
(Moderator): The discussion will revolve around Performance
modeling and objectives • Stress testing & its objectives
• WAS & Act tools and its significance |
| Subhashini
(Moderator): The agenda is as follows: |
| Subhashini
(Moderator): The first 20- 25 mins Naveen will |
| Subhashini
(Moderator): discuss about the topic providing an
insight |
| Subhashini
(Moderator): and the rest 35- 40 mins will be the
space for an open discussion and Q & A |
| Subhashini
(Moderator): Welcome all of you again |
| Subhashini
(Moderator): and hope this session is informative
and useful for all of you. |
| Subhashini
(Moderator): Let’s have Naveen to start... |
Subhashini
(Moderator): Charlie:
hi
Naveen we are waiting for your presentation...
</Code Sample> |
| Subhashini
(Moderator): We have couple of mins left for the discussion
, so let’s take one last question |
| Subhashini
(Moderator): If you have any additional questions,
please feel free to mail Naveen at naveenks@hotmail.com |
| Subhashini
(Moderator): You can mail Naveen at naveen.ks@gmail.com
for any additional queries |
| Subhashini
(Moderator): please make a note of his id |
| Subhashini
(Moderator): Thanks to all you guys who joined us
on the Webchat |
| Subhashini
(Moderator): Thanks to Naveen for taking out the
time to host this Webchat. Let’s hope to hear more from him
in the coming weeks. |
| Subhashini
(Moderator): The next Webchat details will be published
at http://www.microsoft.com/india/communities/chat/default.aspx
. Add this link to your favorites to know whats coming next. |
| Subhashini
(Moderator): Thanks all of you |
| Subhashini
(Moderator): Thanks for joining today |
| Subhashini
(Moderator): Thanks Naveen for the great info |
| Connecting
to chat service... |
| Subhashini
connected. |
| Welcome to the India Community
Chat Room. The chat room will be used for both peer-to-peer, as well
as, event chats. Please abide by the Chat Code of Conduct, located
in the Help file. If you would like to volunteer to be a chat expert,
please register here: |
| http://www.microsoft.com/india/communities/chat/register.aspx.
To view a list of our upcoming chats, please visit: http://www.microsoft.com/india/communities/chat. |
| Chat Room Status:
Open Peer-to-Peer Technical Chat in Progress |
|
| Chat Room Status:
Scheduled Chat in Progress |
JIGS:
Hi
JIGS:
Hi
JIGS:
Hi Naveen
Naveen_MVP
[ Expert]: Thanks
subhashini for introduction
Naveen_MVP
[ Expert]: Hi All....
JIGS:
Hi Naveen
Naveen_MVP
[ Expert]: Hi...
Naveen_MVP
[ Expert]: First I would talk on
Naveen_MVP
[ Expert]: Performance testing &
its objectives
Naveen_MVP
[ Expert]: Then we would move on to
what metric we should concentrate
Naveen_MVP
[ Expert]: finally I would throw some
light on stress tools ..ACT & WAS...
Naveen_MVP
[ Expert]: which stands for Application
Centre Test & Web Application Stress Testing tool..respectively
Naveen_MVP
[ Expert]: okk....let me start
Naveen_MVP
[ Expert]: We all must be thing..we
are developers do we really need to concentrate on Testing?
Naveen_MVP
[ Expert]: that too Performance Testing
& stress Testing.....
Naveen_MVP
[ Expert]: Answer is "Yes"...why
Naveen_MVP
[ Expert]: this would help us to Design
good applications and write efficient code
Naveen_MVP
[ Expert]: So first point would be....Start
to measure performance & stress testing for your application as
soon as you have a defined set of performance objectives for your
application
Naveen_MVP
[ Expert]: this may be when you are
still into nascent stages of your development
Naveen_MVP
[ Expert]: It’s always advisable
to do so...
Naveen_MVP
[ Expert]: During Requirements Analysis....you
must define your performance goals. such as
Charlie
asked the experts: hi
Naveen we are
waiting for your presentation...
Naveen_MVP
[ Expert]: placing an order in e-commerce
site should not take more than 30 sec
Naveen_MVP
[ Expert]: how about while designing
application
Naveen_MVP
[ Expert]: Yes...you need to have
a Design guideline in place for that during "Designing Phase"
Naveen_MVP
[ Expert]: while development you need
to keep tab on code...write as efficient code you can..have a trial-n-error
for your functions
Naveen_MVP
[ Expert]: now you may ask....
Naveen_MVP
[ Expert]: All this is fine but data
we should concentrate
Naveen_MVP
[ Expert]: answer would be
Naveen_MVP
[ Expert]: Metric of particular interest
tends to be response time, throughput, and resource utilization (how
much CPU, memory, disk I/O, and network bandwidth your application
consumes while performing its tasks).
Naveen_MVP
[ Expert]: this data collected can
help us to arrive at a benchmark of results
Naveen_MVP
[ Expert]: which we need to make sure
that we are in lines as per our application’s performance &
stress objectives
Naveen_MVP
[ Expert]: these data's collected
during performance & stress testing can helps us to locate where
exactly are bottlenecks into our applications
Naveen_MVP
[ Expert]: So real question is how
to distribute metrics to collect various data
Naveen_MVP
[ Expert]: its simple...we can have
our metrics divided into various categories...
Naveen_MVP
[ Expert]: like
Naveen_MVP
[ Expert]: • Network. Network
metrics are related to network bandwidth usage
Naveen_MVP
[ Expert]: • System. System
metrics like processor, memory, disk I/O, and network I/O
Naveen_MVP
[ Expert]: • Application. Application
metrics include custom performance counters...
Naveen_MVP
[ Expert]: Application metrics example
as we discussed earlier....e-commerce site with order placing not
taking more than 30 sec
Naveen_MVP
[ Expert]: • Service level.
Service level metrics could be part of Application metrics and would
be related to your application, such as placing order
Naveen_MVP
[ Expert]: also with the invent of
.Net we can include one more metrics from platform point of view
Naveen_MVP
[ Expert]: • Platform. Platform
metrics are related to ASP.NET, and the .NET common language runtime
(CLR).
Naveen_MVP
[ Expert]: Guys...this was end of
Phase 1 ...
Naveen_MVP
[ Expert]: Please...keep asking your
questions....if you have any...
Naveen_MVP
[ Expert]: Now moving on to next....
JIGS:
What is ACT used for ?
JIGS:
only for Load Testing ?
Naveen_MVP
[ Expert]: yes...
Charlie:
what is different b/w ACT and WAS?
Naveen_MVP
[ Expert]: you can’t run a stress
testing with multiple clients in ACT
Naveen_MVP
[ Expert]: as you could do with WAS
Naveen_MVP
[ Expert]: Main difference is ACT
is good for performance testing and
Naveen_MVP
[ Expert]: It’s integrated with
Visual Studio....this helps to review performance during development
Naveen_MVP
[ Expert]: and thirdly it gives nice
graphical results...
Naveen_MVP
[ Expert]: while WAS can be used for
performance as well as stress testing
Naveen_MVP
[ Expert]: With WAS you can have multiple
clients for testing purpose...
Naveen_MVP
[ Expert]: and you can have concurrent
users defined for WAS for stress testing
Naveen_MVP
[ Expert]: let’s move to ACT
testing scenario
JIGS:
ok
Naveen_MVP
[ Expert]: A word of caution here...
Naveen_MVP
[ Expert]: To include all performance
counter and full life cycle testing...you need to start ACT separately
Naveen_MVP
[ Expert]: ACT can be started from
your "Tools" section of "Visual Studio installation"
from program menu
Naveen_MVP
[ Expert]: First...Create an ACT project..
Naveen_MVP
[ Expert]: then create a project scenario...
Naveen_MVP
[ Expert]: you can run your application
as you normally do once your development is complete
Naveen_MVP
[ Expert]: i.e. through browser..
Naveen_MVP
[ Expert]: ACT would collect all the
necessary data to run test
Naveen_MVP
[ Expert]: let’s assume that
you want to find out about response time for placing an order
Charlie: Your mean recording..
Naveen_MVP
[ Expert]: yes...while you are placing
a order through your application
Naveen_MVP
[ Expert]: ACT would collect data
for the same..
Naveen_MVP
[ Expert]: once you are through with
placing the order...stop ACT recording
Naveen_MVP
[ Expert]: Now you can set the Test
properties for your performance testing...
Naveen_MVP
[ Expert]: this would be no.of users
at given time placing the order.... etc
Naveen_MVP
[ Expert]: You can even add some system
resources performance counter
Naveen_MVP
[ Expert]: Run your test and analyze
test results...
JIGS:
(A Question: if lets say my stored procedure is having performance
issue, how can I find out using ACT or WAS )
Naveen_MVP
[ Expert]: Good question
Naveen_MVP
[ Expert]: As I said we have "performance
Counter" that can help us
Naveen_MVP
[ Expert]: You can include SQL Specific
performance counter to monitor
Naveen_MVP
[ Expert]: time taken for that...
Naveen_MVP
[ Expert]: One more thing to add here....
Naveen_MVP
[ Expert]: You can even monitor .Net
CLR specific performance counter for no. of open or closed connections
Naveen_MVP
[ Expert]: Analysis of results is
very important in preparing your report
Naveen_MVP
[ Expert]: First and foremost thing
you need to see is that...
Naveen_MVP
[ Expert]: Was your Test was successful?...
Naveen_MVP
[ Expert]: This can be found through
result codes retrieved by ACT or WAS in form of HTTP codes...
Naveen_MVP
[ Expert]: so for successful test...result
code would be in 200
JIGS:
ok
Naveen_MVP
[ Expert]: while for failed authentication
it would in HTTP 400 series...
Naveen_MVP
[ Expert]: I am expecting a question
here.... :-)
Naveen_MVP
[ Expert]: Ok...let me put for you
guys...
Naveen_MVP
[ Expert]: What if our application
doesn't sustain x no. of connections, what error I would get?
Naveen_MVP
[ Expert]: Simple...it would be in
HTTP 500 series...
Naveen_MVP
[ Expert]: HTTP 500 code means "Server
is not available" |
JIGS:
Naveen_MVP
[ Expert]: This may be due to "Most
queued connections" or Network failure
Naveen_MVP
[ Expert]: You know now what to do..this part of analysis
is very important
Danny:
Hi Naveen. Presently I am doing functionality testing for a .NET application.
What are all the factors I should take care for performance testing
of the same?
JIGS:
I have another Question in Mind... Both ACT and WAS is used for testing
web applications only? or can I test C/S applications also ?
Naveen_MVP
[ Expert]: Good...Question Danny....
Naveen_MVP
[ Expert]: Danny ...it depends what functionality
you are testing...
Naveen_MVP [
Expert]: As I said earlier if you are looking for
"Order Plaing functionality"...then
Naveen_MVP
[ Expert]: You need to look for Latency measured at
the server & Latency measured at the client
Naveen_MVP
[ Expert]: Latency measured at the server means...time
taken by the server to complete the execution of a request
Danny:
Basically it is a web based CRM application which is completely built
on .Net. This application has interoperability with few legacy systems
too.
Naveen_MVP [ Expert]:
Latency measured at the client includes the request queue, the time
taken by the server to complete the execution of the request, and
the network latency.
Naveen_MVP
[ Expert]: Apart from that danny you need include
some platform specific counters from .Net framework point of view
Danny: Ok. Please list
them
Naveen_MVP [ Expert]:
such as .NET CLR Interop\# of marshalling...this would find
Naveen_MVP
[ Expert]: how many times your application switched
from Managed platform to un-Managed platform and back
Naveen_MVP
[ Expert]: This would even help you too find whether
Managed code is taking more time or your legacy Un-managed
Naveen_MVP
[ Expert]: Coming to JIG"s question
Naveen_MVP
[ Expert]: Jig.. you can test Web Applications, Windows
and web services etc
Charlie:
I have one basic question, how to create v-user(concurrent user) in
ACT
Naveen_MVP [ Expert]:
Charlier...there is an option in ACT to create users
Naveen_MVP
[ Expert]: You can even let ACT to create concurrent
users for your application
Naveen_MVP
[ Expert]: Let me add one more thing
Naveen_MVP
[ Expert]: For WAS too is the same case
Naveen_MVP
[ Expert]: For application which requires domain specific
users..you can even create in text file and provide a path in WAS
Danny: Is there any
evaluation versions available for these tools?
Naveen_MVP
[ Expert]: ACT is shipped with Visual Studio free
of cost...
Danny:
Ok
Naveen_MVP [ Expert]:
while WAS is available at Microsoft...
Naveen_MVP
[ Expert]: let me give you URL..
Naveen_MVP
[ Expert]: http://www.microsoft.com/downloads/details.aspx?FamilyID=e2c0585a-062a-439e-a67d-75a89aa36495&displaylang=en
Naveen_MVP [ Expert]:
This would help in get going
Naveen_MVP
[ Expert]: http://support.microsoft.com/default.aspx?scid=kb;en-us;313559
Naveen_MVP [ Expert]:
Time bomb is clicking...need to stop
Danny:
Ok Thank you for your valuable information
JIGS:
Thanks Naveen , will so some more learning on ACT and WAS , and will
ask more questions in your coming advance sessions on the same.
Naveen_MVP [ Expert]:
Hope you guys have enjoyed this chat...if you have any further questions
please me
Naveen_MVP [ Expert]:
Always welcome Danny & JIGS...
Charlie:
Thanks Naveen...we'll need ur id...
Naveen_MVP
[ Expert]: My email id is Naveen dot ks at gmail
Naveen_MVP [ Expert]:
Thanks a lot to all for joining...
Naveen_MVP
[ Expert]: Have a Nice evening and Bye
Charlie:
Bye Naveen.... |
