Re: How do you read the content of internal web pages?

From:

Daniel Pitts <googlegroupie@coloraura.com>

Newsgroups:

comp.lang.java.programmer

Date:

Wed, 25 Jul 2007 12:45:11 -0700

Message-ID:

<1185392711.114421.200940@d55g2000hsg.googlegroups.com>

On Jul 25, 11:32 am, Manish Pandit <pandit.man...@gmail.com> wrote:

On Jul 25, 11:22 am, Thierry Lam <lamthie...@gmail.com> wrote:

I have the following jsp pages on different tomcat web servers:

http://serverone/bugs/download.jsp?num=1234&file=Jul25.txthttp://serv...

Is there a way in java to read the content of those urls? I can do it
easily in perl with the module LWP::UserAgent

http://search.cpan.org/~gaas/libwww-perl-5.805/lib/LWP/UserAgent.pm

Does anyone have the equivalent for java?

Thierry

You cannot read the "content" of the JSPs, but you can, however, read
the "output" of those JSPs as if your code is a browser, which is what
I think you meant by User Agent. You can either use Apache's
HttpClient API (my preference), or roll your own using the
java.net.URLConnection. You will find plenty of examples if you google
these two APIs.

It is not as straightforward as LWP :)

Actually, it is very straightforward. You don't need to mess with
URLConnection for retreiving the content of specific URLs, new
URL(urlString).getContent() should do the trick.

-cheers,
Manish

Daniel.