Re: Changing raw text to unicode format using Standard Java APIs

From:

Mark Space <markspace@sbc.global.net>

Newsgroups:

comp.lang.java.programmer

Date:

Thu, 30 Apr 2009 07:48:42 -0700

Message-ID:

<FTiKl.20090$as4.13732@nlpi069.nbdc.sbc.com>

theAndroidGuy wrote:

unicode format. Also I'd like to know the basic encoding format for
any webpage, I think most of the times the encoding happens to be

I'd assume that you could use HttpURLConnectin for that, although I
haven't tried it. Note esp. the methods in its parent class.

<http://java.sun.com/javase/6/docs/api/java/net/HttpURLConnection.html>

unicode utf-8 for non-english contents as well, but what if this is
not the case then how to convert that to unicode. Any suggestions
would be appreciated.

You've already been pointed at the Charset class. Note that both
Reader/Writer and Strings have methods for changing charsets around. E.g.

   String s = ...
   byte[] b = s.getBytes( "UTF-8" );

   OutputStream os = ...
   OutputStreaWriter osw = new OutputStreamWriter( os, "UTF-8" );
   osw.write( s, 0, s.length() );

And similarily for InputStreamWriter. (You'd normally wrap those
InputStreamReader/OutputStreamWriter in a BufferedReader/Writer of some
sort).