Re: Java URL

From:

Dale King <"DaleWKing [at]gmail [dot] com">

Newsgroups:

comp.lang.java.help

Date:

Sat, 10 Jun 2006 13:42:04 -0400

Message-ID:

<DsKdnYaAPaoXmRbZnZ2dnUVZ_rKdnZ2d@insightbb.com>

Roland de Ruiter wrote:

That's right, Google blocks Java clients. But it can be 'circumvented'
quite easily by setting the User-Agent request header with a value used
by well known browsers. In OP's code:

But doing so is a violation of Google's terms of service
(http://www.google.com/terms_of_service.html) which says:

"You may not send automated queries of any sort to Google's system
without express permission in advance from Google."

Google does provide a way to get permission for automated queries for
your own personal use. Google provides a SOAP API, including Java
example code on how to use it. To use it you have to sign up for a
Google account and use your login in your query. This entitles you to
1000 automated queries per day.

If you need something more than that you will have to negotiate a
license with Google.

And it has been reported here recently that Google has ways of detecting
automated use and will start popping up a CAPTCHA
(http://en.wikipedia.org/wiki/Captcha) when you submit queries from your IP.

--
Dale King