From m.nacos at gmail.com  Fri Jul  4 13:55:52 2008
From: m.nacos at gmail.com (Michael Nacos)
Date: Fri Jul  4 14:00:50 2008
Subject: [Tsung] postgresql testing - authentication / phases / open
	connections
Message-ID: <407fa4640807040455t527c406et7cfa1a82f9354c41@mail.gmail.com>

Hello to everyone.

<some background>

I am a total Erlang newbie (I-have-written-a-little-bit-of-demo-code level)
but I am falling in love with the language.
I have also just started a new job, as Postgresql DBA and Tsung may just be
my big Erlang break:
My company has serious load testing needs, Tsung is exactly what they
couldn't find before, it's got a postgres module,
and a big part of my job will be scalability tests, so Tsung might just be
my ticket to programming Erlang professionally
(they will probably be very happy if I come up with some Erlang code for
test case randomization or other cool things)
And, by the way, I really enjoyed the Erlang Exchange. Thanks, guys.

</some background>

I have been trying to load test one of our development Postgres servers,
using a very simple setup (no distribution/
coordination of multiple machines). Now, the results I get if I run my test
scenario on the actual db server present
some qualitative differences compared to the results I get if the tests
originate on another machine connecting through
port 5432 (-- I am using the same tsung.xml file in both cases, of course)

The total size_sent (kbits) lines in both cases match the relevant patterns
in the users arrival graph. The size_rcv lines
are not consistent, though. In the local test, the size_rcv line linearly
grows up to 100 users (simultaneous) then becomes
horizontal - which may have something to do with the default postgres
setting for 100 max_connections. Does this mean
the same original 100 connections are maintained throughout the test, even
after the queries have finished, so there is no
more data coming in?

The size_rcv line for the remote test, however, always stays very near zero.
Now, the total errors graph matches exactly the
total user arrival graph, so I am kind of assuming something is going
horribly wrong with the remote queries (users
send by don't receive).

Now, I have tried to run the following line in both machines (local and
remote, where local is the server) and it works
fine in both cases. The only difference is I am using the trust model for
local pg connections (so I don't get asked for
a password when I run this on the server) and the md5 model for remote pg
connections (so I get asked for a password
when I run this on the remote machine) - I am assuming this is an
authentication problem, then.

cat test.sql | psql -U user -h localhost -p 5432 database

I have also tried to change the model for remote pg connections to password
(clear text over the net, bad idea), but I
get exactly the same behaviour. Is there something broken with tsung's
authentication mechanism, or is there something
wrong in my xml file:

    <transaction name="connection">
        <request>
           <pgsql type="connect" database="database" username="user" />
        </request>
    </transaction>

    <request><pgsql type="authenticate" password="pass"/></request>

Another thing concerns arrival phases:

I have specified three arrival phases in the xml file, a fast one followed
by a slow one, followed by a fast one (this
doesn't need to make sense, I am just experimenting with the software).
Tests from the local machine show an
expected ladder-like pattern when it comes to the
graphes-Users_Arrival-total graph, tests from the remote machine
don't (it's quite linear). Similar patterns may be observed in the total
kbits size_sent graphs and the total errors graphs,
so I think for some reason user arrival doesn't go as planned in the remote
test box case. Any ideas?

There is also the matter of finished users in the local test. For some
reason, those 100 users which are able to
connect don't seem to finish. In fact, there is a constant difference of
about 100 users between users_count and
finish_users_count throughout the graph, start to finish.
The number of simultaneous connections which remain after the end of the
experiment confirms this.
Should this happen, considering I have included the following line in
tsung.xml?

    <request><pgsql type="close"></pgsql></request>

Finally, in the transaction graphs I also get something called page (which,
by the way, is huge - its mean value
reaches 60000 msec at some stages).

Any help will be appreciated...

Michael
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.process-one.net/pipermail/tsung-users/attachments/20080704/fe28827e/attachment.html
From m.nacos at gmail.com  Fri Jul  4 14:26:04 2008
From: m.nacos at gmail.com (Michael Nacos)
Date: Fri Jul  4 14:30:35 2008
Subject: [Tsung] Re: postgresql testing - authentication / phases / open
	connections
In-Reply-To: <407fa4640807040455t527c406et7cfa1a82f9354c41@mail.gmail.com>
References: <407fa4640807040455t527c406et7cfa1a82f9354c41@mail.gmail.com>
Message-ID: <407fa4640807040526y7625abc8tcee171710f96f6ea@mail.gmail.com>

minor corrections to the questions:

sorry, I was wrong when I said I didn't see anything different when I
switched pg connect model from md5 to password - I was looking at the wrong
graphs. So the password model works - does tsung also support md5?

and yes, the remote test with password (not md5) authentication has worked
like a charm - very happy.

but the questions regarding the local server (testing client - tested server
were the same machine) remain.
and what is page in the graphs?

Michael

On Fri, Jul 4, 2008 at 12:55 PM, Michael Nacos <m.nacos@gmail.com> wrote:

> Hello to everyone.
>
> <some background>
>
> I am a total Erlang newbie (I-have-written-a-little-bit-of-demo-code level)
> but I am falling in love with the language.
> I have also just started a new job, as Postgresql DBA and Tsung may just be
> my big Erlang break:
> My company has serious load testing needs, Tsung is exactly what they
> couldn't find before, it's got a postgres module,
> and a big part of my job will be scalability tests, so Tsung might just be
> my ticket to programming Erlang professionally
> (they will probably be very happy if I come up with some Erlang code for
> test case randomization or other cool things)
> And, by the way, I really enjoyed the Erlang Exchange. Thanks, guys.
>
> </some background>
>
> I have been trying to load test one of our development Postgres servers,
> using a very simple setup (no distribution/
> coordination of multiple machines). Now, the results I get if I run my test
> scenario on the actual db server present
> some qualitative differences compared to the results I get if the tests
> originate on another machine connecting through
> port 5432 (-- I am using the same tsung.xml file in both cases, of course)
>
> The total size_sent (kbits) lines in both cases match the relevant patterns
> in the users arrival graph. The size_rcv lines
> are not consistent, though. In the local test, the size_rcv line linearly
> grows up to 100 users (simultaneous) then becomes
> horizontal - which may have something to do with the default postgres
> setting for 100 max_connections. Does this mean
> the same original 100 connections are maintained throughout the test, even
> after the queries have finished, so there is no
> more data coming in?
>
> The size_rcv line for the remote test, however, always stays very near
> zero. Now, the total errors graph matches exactly the
> total user arrival graph, so I am kind of assuming something is going
> horribly wrong with the remote queries (users
> send by don't receive).
>
> Now, I have tried to run the following line in both machines (local and
> remote, where local is the server) and it works
> fine in both cases. The only difference is I am using the trust model for
> local pg connections (so I don't get asked for
> a password when I run this on the server) and the md5 model for remote pg
> connections (so I get asked for a password
> when I run this on the remote machine) - I am assuming this is an
> authentication problem, then.
>
> cat test.sql | psql -U user -h localhost -p 5432 database
>
> I have also tried to change the model for remote pg connections to password
> (clear text over the net, bad idea), but I
> get exactly the same behaviour. Is there something broken with tsung's
> authentication mechanism, or is there something
> wrong in my xml file:
>
>     <transaction name="connection">
>         <request>
>            <pgsql type="connect" database="database" username="user" />
>         </request>
>     </transaction>
>
>     <request><pgsql type="authenticate" password="pass"/></request>
>
> Another thing concerns arrival phases:
>
> I have specified three arrival phases in the xml file, a fast one followed
> by a slow one, followed by a fast one (this
> doesn't need to make sense, I am just experimenting with the software).
> Tests from the local machine show an
> expected ladder-like pattern when it comes to the
> graphes-Users_Arrival-total graph, tests from the remote machine
> don't (it's quite linear). Similar patterns may be observed in the total
> kbits size_sent graphs and the total errors graphs,
> so I think for some reason user arrival doesn't go as planned in the remote
> test box case. Any ideas?
>
> There is also the matter of finished users in the local test. For some
> reason, those 100 users which are able to
> connect don't seem to finish. In fact, there is a constant difference of
> about 100 users between users_count and
> finish_users_count throughout the graph, start to finish.
> The number of simultaneous connections which remain after the end of the
> experiment confirms this.
> Should this happen, considering I have included the following line in
> tsung.xml?
>
>     <request><pgsql type="close"></pgsql></request>
>
> Finally, in the transaction graphs I also get something called page (which,
> by the way, is huge - its mean value
> reaches 60000 msec at some stages).
>
> Any help will be appreciated...
>
> Michael
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.process-one.net/pipermail/tsung-users/attachments/20080704/dc64117f/attachment.html
From nicolas at niclux.org  Wed Jul  9 15:11:27 2008
From: nicolas at niclux.org (Nicolas Niclausse)
Date: Wed Jul  9 15:10:59 2008
Subject: [Tsung] Re: postgresql testing - authentication / phases / open
	connections
In-Reply-To: <407fa4640807040526y7625abc8tcee171710f96f6ea@mail.gmail.com>
References: <407fa4640807040455t527c406et7cfa1a82f9354c41@mail.gmail.com>
	<407fa4640807040526y7625abc8tcee171710f96f6ea@mail.gmail.com>
Message-ID: <4874B8FF.1050206@niclux.org>

Michael Nacos ecrivait le 04.07.2008 14:26:

Hello,

thanks for your feedback;

> minor corrections to the questions:
> 
> sorry, I was wrong when I said I didn't see anything different when I 
> switched pg connect model from md5 to password - I was looking at the 
> wrong graphs. So the password model works - does tsung also support md5?

md5 authentication is supported in svn  (it does not work in 1.2.2)

> and yes, the remote test with password (not md5) authentication has 
> worked like a charm - very happy.
> 
> but the questions regarding the local server (testing client - tested 
> server were the same machine) remain.

Can you try again with the latest version from subversion and report your 
results to the list ?

> and what is page in the graphs?

a page is a set of requests not separated by thinktimes

-- 
Nicolas
From nicolas at niclux.org  Wed Jul  9 15:14:58 2008
From: nicolas at niclux.org (Nicolas Niclausse)
Date: Wed Jul  9 15:14:27 2008
Subject: [Tsung] message "Erlang version has changed"
In-Reply-To: <b7845e9a0806271545i3be0e7b5gd3b5080e9db58e37@mail.gmail.com>
References: <b7845e9a0806271545i3be0e7b5gd3b5080e9db58e37@mail.gmail.com>
Message-ID: <4874B9D2.7060409@niclux.org>

Eugene Pik ecrivait le 28.06.2008 00:45:
> I have installed Tsung 1.2.2 and Erlang 5.6
> At the start time I receive few messages that telling me to run it as
> root. I did so, but the messages appear again each time I start tsung.

hmm, running once as root should resolve the problem; maybe it's a bug ...

> Is there any solution? Or I shouldn't be worried about these at all?

You can rebuild tsung from source with your version of erlang; it should 
resolve the problem

-- 
Nicolas
From nicolas at niclux.org  Thu Jul 10 10:40:05 2008
From: nicolas at niclux.org (Nicolas Niclausse)
Date: Thu Jul 10 10:39:38 2008
Subject: [Tsung] Re: postgresql testing - authentication / phases / open
	connections
In-Reply-To: <407fa4640807090925sde6a99dsbad3f89bf602186e@mail.gmail.com>
References: <407fa4640807040455t527c406et7cfa1a82f9354c41@mail.gmail.com>	
	<407fa4640807040526y7625abc8tcee171710f96f6ea@mail.gmail.com>	
	<4874B8FF.1050206@niclux.org>
	<407fa4640807090925sde6a99dsbad3f89bf602186e@mail.gmail.com>
Message-ID: <4875CAE5.9070601@niclux.org>

Michael Nacos ecrivait le 09.07.2008 18:25:

> more or less, I get approx 100 simultaneous connections, which is what 
> I'd expect, as this is the max_connect pgsql setting.
> but the size_rcv curve is flat, after a certain stage, and anyhow, I'd 
> expect it to be much higher than size_sent.
> 
> the server is under stress, I can certainly see that with ps/top etc., 
> but are the clients getting any results and if yes, why don't I see that 
> in the graphs? (please have a look at graphes-Size-total.png)

This is strange indeed.

Do you have errors (error_pgsql ) ? Maybe there is a problem with the 
requests and the server is responding with very short messages ??


in the logs files, you should have lines like:
=INFO REPORT==== 10-Jul-2008::10:23:02 ===
          ts_pgsql:(5:<0.88.0>) PGSQL: Got Error Msg from postgresql 
[[{severity,
 
'ERROR'},
                                                                          etc.

(loglevel must be at least notice  (or info or debug))

Otherwise, you can start a test with a single client with debug level and 
dumptraffic=true and send me the logfiles )

-- 
Nicolas
From nicolas at niclux.org  Thu Jul 10 11:44:22 2008
From: nicolas at niclux.org (Nicolas Niclausse)
Date: Thu Jul 10 11:43:53 2008
Subject: [Tsung] Override Host: Header
In-Reply-To: <486514C5.3080206@bearstech.com>
References: <486501E4.50905@bearstech.com> <48650DC1.4030100@niclux.org>
	<486514C5.3080206@bearstech.com>
Message-ID: <4875D9F6.5080007@niclux.org>

Rodolphe Quiedeville ecrivait le 27.06.2008 18:26:
> Nicolas Niclausse a ?crit :
>> Rodolphe Quiedeville ecrivait le 27.06.2008 17:06:
>>> Hi,
>>>
>>> Is it possible to override the Host: header information when
>>> benchmarking HTTP server ?
>>> I tried to add :
>>>
>>> <http_header name="Host" value="www.NAME.com"/>
>>>
>>> but it sends after the first Host header reads from the servers section.
>> Can you retry with this patch ?
>>

Hello,

> A very little bug, below my traffic dump, in the first send it's ok, but
> in the second I have an 2 ^M beetwen User-Agent and Host and apache it's
> little worried by that.

I can't reproduce this behaviour

> Perhaps it could be better to send Host: before User-Agent ?

The following patch does this.

-- 
Nicolas
-------------- next part --------------
A non-text attachment was scrubbed...
Name: headers.patch
Type: text/x-patch
Size: 4043 bytes
Desc: not available
Url : http://lists.process-one.net/pipermail/tsung-users/attachments/20080710/01bc37d1/headers.bin
From m.nacos at gmail.com  Wed Jul  9 18:25:24 2008
From: m.nacos at gmail.com (Michael Nacos)
Date: Mon Jul 14 09:37:24 2008
Subject: [Tsung] Re: postgresql testing - authentication / phases / open
	connections
In-Reply-To: <4874B8FF.1050206@niclux.org>
References: <407fa4640807040455t527c406et7cfa1a82f9354c41@mail.gmail.com>
	<407fa4640807040526y7625abc8tcee171710f96f6ea@mail.gmail.com>
	<4874B8FF.1050206@niclux.org>
Message-ID: <407fa4640807090925sde6a99dsbad3f89bf602186e@mail.gmail.com>

Dear Nicolas,

thank you for your answer. The page question is a classic RTFM case.
However, I am very perplexed with the output I get from running some very
intense queries on our dev pgsql server (I am using the svn version now -
revision 861)

more or less, I get approx 100 simultaneous connections, which is what I'd
expect, as this is the max_connect pgsql setting.
but the size_rcv curve is flat, after a certain stage, and anyhow, I'd
expect it to be much higher than size_sent.

the server is under stress, I can certainly see that with ps/top etc., but
are the clients getting any results and if yes, why don't I see that in the
graphs? (please have a look at graphes-Size-total.png)

I'm attaching a couple of graphs fyi

Michael

On Wed, Jul 9, 2008 at 2:11 PM, Nicolas Niclausse <nicolas@niclux.org>
wrote:


> Can you try again with the latest version from subversion and report your
> results to the list ?
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.process-one.net/pipermail/tsung-users/attachments/20080709/8c6fd648/attachment.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graphes-Users_Arrival-total.png
Type: image/png
Size: 3007 bytes
Desc: not available
Url : http://lists.process-one.net/pipermail/tsung-users/attachments/20080709/8c6fd648/graphes-Users_Arrival-total.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graphes-Errors-total.png
Type: image/png
Size: 2325 bytes
Desc: not available
Url : http://lists.process-one.net/pipermail/tsung-users/attachments/20080709/8c6fd648/graphes-Errors-total.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graphes-Size-total.png
Type: image/png
Size: 2611 bytes
Desc: not available
Url : http://lists.process-one.net/pipermail/tsung-users/attachments/20080709/8c6fd648/graphes-Size-total.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graphes-Users-simultaneous.png
Type: image/png
Size: 3209 bytes
Desc: not available
Url : http://lists.process-one.net/pipermail/tsung-users/attachments/20080709/8c6fd648/graphes-Users-simultaneous.png
From sreenivasan.sreeramu at gmail.com  Tue Jul 29 12:29:15 2008
From: sreenivasan.sreeramu at gmail.com (Sreenivasan K)
Date: Tue Jul 29 12:33:55 2008
Subject: [Tsung] New to tesung
Message-ID: <f7900eba0807290329h5d1768dbm14b876b16db017fc@mail.gmail.com>

Hi friends i am new to erlang and i came to know that tsung . And my
question is : is't possible to run tsung in windows xp.....???if yes
means please guide me how to install in windows xp ....
From rquiedeville at bearstech.com  Tue Jul 29 12:46:06 2008
From: rquiedeville at bearstech.com (Rodolphe Quiedeville)
Date: Tue Jul 29 12:45:34 2008
Subject: [Tsung] New to tesung
In-Reply-To: <f7900eba0807290329h5d1768dbm14b876b16db017fc@mail.gmail.com>
References: <f7900eba0807290329h5d1768dbm14b876b16db017fc@mail.gmail.com>
Message-ID: <488EF4EE.1010505@bearstech.com>

Sreenivasan K a ?crit :
> Hi friends i am new to erlang and i came to know that tsung . And my
> question is : is't possible to run tsung in windows xp.....???if yes
> means please guide me how to install in windows xp ....

Hi,

As indicated in http://tsung.erlang-projects.org/user_manual.html#htoc12
tsung runs on Wins32. Unfamiliar with proprietary system I can't guide
you to install it, but I'm sure you'll be able to do it by yourself
after read the online documentation.

Regards

-- 
Rodolphe Quiedeville
www.bearstech.com

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 252 bytes
Desc: OpenPGP digital signature
Url : http://lists.process-one.net/pipermail/tsung-users/attachments/20080729/eae347f3/signature.pgp
From nicolas at niclux.org  Tue Jul 29 13:02:26 2008
From: nicolas at niclux.org (Nicolas Niclausse)
Date: Tue Jul 29 13:01:39 2008
Subject: [Tsung] New to tesung
In-Reply-To: <488EF4EE.1010505@bearstech.com>
References: <f7900eba0807290329h5d1768dbm14b876b16db017fc@mail.gmail.com>
	<488EF4EE.1010505@bearstech.com>
Message-ID: <488EF8C2.9090804@niclux.org>

Rodolphe Quiedeville ecrivait le 29.07.2008 12:46:
> Sreenivasan K a ?crit :
>> Hi friends i am new to erlang and i came to know that tsung . And my
>> question is : is't possible to run tsung in windows xp.....???if yes
>> means please guide me how to install in windows xp ....
> 
> Hi,
> 
> As indicated in http://tsung.erlang-projects.org/user_manual.html#htoc12
> tsung runs on Wins32. 

The manual says that it SHOULD work on Win32; i never tried it myself.


> Unfamiliar with proprietary system I can't guide
> you to install it, but I'm sure you'll be able to do it by yourself
> after read the online documentation.

Someone once reported a success on Win32, after a bit of tweaking. So i'am 
not sure it will work out of the box

-- 
Nicolas
From phvander at gmail.com  Wed Jul 30 10:49:43 2008
From: phvander at gmail.com (philippe vanderstraeten)
Date: Wed Jul 30 10:48:52 2008
Subject: [Tsung] Tsung and Erlang support on Red Hat Enterprise Linux PowerPC
Message-ID: <12d458770807300149p1f40aa2co9552dd8c5b94a6f1@mail.gmail.com>

Hi,

I just want to know if some one had run TSUNG on  Red  Hat Enterprise Linux
version 4 on PowerPC
Thanks
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.process-one.net/pipermail/tsung-users/attachments/20080730/881d9f68/attachment.html