Re: Automating Searches
nowwho@gmail.com wrote:
....
New to Java! Trying to automate searhing Google,
See the Google search API, but be prepared to pay,
for anything beyond the nominal numbers of queries
the Google API permits for free.
...Yahoo, MSN, AOL and Ask ...
Dunno.. Aren't most of them using data from
Google, in any case?
...by sending queries to those engines using a java program and
storing the returned URL's in a MYSQL database.
Why would your users prefer to query your DB, than
query Google directly (for up to the moment data)?
...The program will open a
text file, upload the first line as the query, connect to each of the
search engines,
.....
Is it possible to do this and store the first 100 URL's the query
returns from each search engine?
Certainly - through whatever public API the search
engine offers - talk to their tech. departments and
they'll most probably instruct you how to get the
data as XML (or something else conveniently as
portable and easily parsable).
Andrew T.