Re: How to make the each looping concurrent thread to improve WHILE-loop performance?

From:

"Daniel Pitts" <googlegroupie@coloraura.com>

Newsgroups:

comp.lang.java.programmer

Date:

2 Feb 2007 09:36:59 -0800

Message-ID:

<1170437819.310383.326630@j27g2000cwj.googlegroups.com>

On Feb 2, 4:08 am, "Chris Uppal" <chris.up...@metagnostic.REMOVE-
THIS.org> wrote:

Daniel Pitts wrote:

First, look into using Batches instead of concurrency.

The way you have capitalised "Batches" makes it sound as if there's a specific
software package with that name which would help with this sort of problem. I
haven't heard of one myself (and Google shows nothing obviously helpful); am I
missing something interesting ?

-- chris

Ah, sorry. I was struck by the RCM (Random Capitalisation Monster).
When you are inserting or updating many rows in a database, you can
often "batch" the process to improve throughput. Most database
interfaces support batching.

Basically, the concept goes like this:
1. Start batch
2. Insert a bunch of rows
3. commit batch
4. --- All of the inserts get sent to the DB in one go.

This has the downside that you can't rely on side-effects of the
inserts until after commit. Specifically, you can't get the auto-
generated primary key for each insert.