[Tsung] Generating over 32k clients from a single machine

[Vinod Panicker]

OK so the multiple IP thing wasn't really working out (though I
thought so).  A netstat dump showed that tsung was using just a single
IP address to generate the load.
According to the configuration though, it was *not* supposed to use
that IP address.  Seems like I've stumbled across a bug.  I'm using
tsung revision 722 from svn (since the latest available one was giving
errors that were reported already by someone on the list)

In summary, tsung is configured to use 4 clients, all of which are
hostnames mapping to individual IP's of the client machine. The client
machine has 2 NIC's, each of which is assigned 2 IP addresses.  Tsung
ends up using just one of those IP addresses to generate load and
eventually runs out of available client ports after 65k connections.

Regards,
Vinod.

On Wed, Feb 20, 2008 at 8:50 PM, Vinod Panicker <vinod.p at gmail.com> wrote:
> Hi,
>
>  Yea the multiple ip solution worked fine.  I'm trying to figure out
>  why there's a limit for 32k clients.  Will let you know if I find
>  something.
>
>  Regards,
>  Vinod.
>
>
>
>  On Feb 20, 2008 8:17 PM, Jason Tucker <jasonwtucker at gmail.com> wrote:
>  > Hi Vinod -
>  >
>  > My I had my load generator box configured with 8 IP addresses... 1 per CPU
>  > basically.
>  >  It is curious problem only getting 32k, though. It would be interesting to
>  > see if multiple IPs helps get around the problem.
>  >
>  > Good luck!
>  >
>  > __Jason
>  >
>  >
>  >
>  > On Feb 20, 2008 2:00 AM, Vinod Panicker <vinod.p at gmail.com> wrote:
>  > > Hi Jason,
>  > >
>  > >
>  > > On Feb 19, 2008 9:20 PM, Jason Tucker <jasonwtucker at gmail.com> wrote:
>  > > > I've been able to generate close to 200K concurrent connections from a
>  > > > single Solaris 10 box (using multiple IP addresses to get around TCP
>  > port
>  > > > limitations). In addition to ports, make sure your system has enough
>  > > > available filehandles as well.
>  > >
>  > > How many ip's did you end up using?
>  > > Yes, the system is configured for a huge number of file handles.
>  > >
>  > >
>  > > > Actually, the multiple IP solution might be something to try, if you
>  > haven't
>  > > > already. You should be able to configure multiple "secondary" IP
>  > addresses
>  > > > to your box and then spread your client processes across them. If for
>  > some
>  > > > reason you are hitting a hard limit of ~32K per IP, using multiple IPs
>  > might
>  > > > get you around it.
>  > > >
>  > > > You are using SMP erlang, yes?
>  > >
>  > > Yes I think the multiple IP address solution should do the trick!
>  > > Dunno why it didn't occur to be earlier :)
>  > > Yes, I'm using SMP erlang and kernel poll and have also increased the
>  > > number of allowed erlang processes.
>  > >
>  > > But I wonder why the hard limit is not 64k (or if this is a hard limit
>  > > problem at all)
>  > >
>  > > Regards,
>  > > Vinod.
>  > >
>  >
>  >
>  >
>  >
>  > --
>  > Please help support my participation in Philly's Livestrong Challenge:
>  >  http://philly08.livestrong.org/tuckerjw
>  >
>  > Find me on Facebook:
>  > http://www.facebook.com/profile.php?id=1016862963
>  >
>