Re: nThreads
Joerg Meier wrote:
markspace wrote:
However, 100 to 300 threads is trivial for most modern system. Since
most tasks will be IO-bound, it make sense to have lots of threads so
some can be running while others wait for data to be returned. (Sorry
to contradict Mr. Meier but I'm pretty sure he's off base.) Given a
Obviously, you can pretty much have Integer.MAX_VALUE threads if all of
them are waiting without negatively impacting your waiting performance -
that's not really a sensible way to look at that question ;)
Perhaps not, but see below.
I said, and stand by, that context switching is not free and is the cost of
having too many threads. Threads that sleep or otherwise wait, such as for
IO, don't typically cause much context switching.
But how "not free" is it? Let's look at your experience in a minute.
That being said, I would expect the case of 100s of threads waiting for IO
probably an edge case (for use cases such as web servers), and the majority
of cases would have IO restricted to a small number of the threads. YMMV.
3000 is probably approaching some sort of upper limit on most "average"
servers. Don't neglect to measure actual running performance, but I
don't think commodity hardware can handle that many practically.
We once ran (by accident) something that triggered 100,000 threads (+ GC
and whatever) on a normal Linux server with a quad core CPU and it still
worked (although much slower than with the intended 100). As far as I know,
neither Linux nor the hardware was anything unusual.
The question is how much slower, and whether 1,000 threads would have experienced
a severe slowdown for that setup. Or 10,000.
Quite often resource limits show up as a discontinuity in the scaling graph. Service time
degrades gracefully up to some n, then catastrophically above that.
In your case there might have been such a knee in that 10^3- 10^4 range. The numbers
would tell.
And that's the point for the OP. You cannot know ahead of time what the right number is,
really. You need to measure, under realistic loads. (And be pretty good at simulating "realistic".)
Notice that answers here are in terms of "if you're I/O bound", "if you're waiting", "if this", "if that".
You need to know which ifs apply to your case.
--
Lew