Re: change ISO8859-1 to GB2312
On 5=E6=9C=8825=E6=97=A5, =E4=B8=8A=E5=8D=886=E6=97=B609=E5=88=86, RedGritt=
yBrick <RedGrittyBr...@SpamWeary.invalid>
wrote:
On 24/05/2010 15:04, moonhkt wrote:
Our system is P630.
No , Suppose just two charset on file. ISO8859-1/GB2312 to UTF-8 or
EBCDID
For compare the different output by using UNIX diff command.
Your task can be broken down into three elements:
1) Read ISO-8859-1 encoded text from database.
2) Convert incorrectly encoded text back into Unicode UTF-16
3) Convert UTF-16 to UTF-8 (or EBCDIC)
For the first part, Your JDBC drivers should provide a way to make sure
the correct encoding conversion is performed so that whatever encoding
the database is using is known to the driver and it can convert text to
the UTF-16 encoding used by Java. See your DBMS documentation.
The second part is tricky. Your database thinks the GB2312 data is
ISO-8859-1 (because you lied to it). Now java is under the same illusion
and has done the arithmetic that would normally convert from ISO-8859-1
to Unicode/UTF-16. This has probably made an unholy mess of the GB2312
data. You have to reverse this. It's late, I'm tired and I just don't
care enough at the moment to think about how this would be done. (later)
I think I would use java.lang.String's methods to convert to byte[]
using ISO-8859-1 conversion then restore to String form using GB2312
conversion. I'm assuming the GB2312 data pretending to be ISO-8859-1 is
in a separate field in a table and hence in a separate
ResultSet.getString() result. If not ... oh dear.
The last part is easy - see below. I just output some GB2312 characters
using EUC-CN encoding into a HTML file because my web-browser, Firefox,
understands GB2312 - it's a convenient way to check the correctness of
the conversion. You want UTF-8 or EBCDIC not GB2312 but the principle is
the same.
-------------------------------8<------------------------------
import java.io.FileNotFoundException;
import java.io.PrintWriter;
import java.io.UnsupportedEncodingException;
public class TestGB2312 {
public static void main(String[] args) {
/*
* Note: The fun characters are specified as Unicode =
escapes.
* We later get Java to convert to GB2312 in EUC_CN e=
ncoding.
*/
String data = "<html><head><meta charset=\"gb2312=
\"></head><body>"
+ "<p>Character set:GB2312</p>" =
+ "<p>Encoding: EUC_CN</p>"
+ "<p>Roman Numerals: \u2160\u21=
61\u2162\u2163</p>"
+ "<p>Han (Numerals): \u3220\u32=
21\u3222\u3223</p>"
+ "</body></html>";
writeFileAsGB2312("GB2312.html", data);
}
private static void writeFileAsGB2312(String fileName, Strin=
g data) {
PrintWriter pw;
try {
pw = new PrintWriter(fileName, "GB2312");
pw.println(data);
pw.close();
} catch (FileNotFoundException e) {
e.printStackTrace();
} catch (UnsupportedEncodingException e) {
e.printStackTrace();
}
}
}
-------------------------------8<------------------------------
Where I've got "GB2312" and "gb2312" you might want "UTF-8" and "utf8".
See
<http://java.sun.com/javase/6/docs/technotes/guides/intl/encoding.doc....=
I imagine you knew all the above and were hoping for help with the part
which I numbered 2.
--
RGB
Thank. I am not testing JDBC.
But tired to GB2312 file , to UTF-8 then BIG5
10 TEST1 |=E6=B5=8B=E8=AF=951
11 TEST2 |=E6=B5=8B=E8=AF=952
13 TEST4 |=E6=B5=8B=E8=AF=954
it can conv to UTF-8
When conv UTF-8 to BIG5, can not. Do you know why ?
Checked with IE, the BIG5 code is "?"
import java.io.*;
public class Conv_cp
{
public static void help ()
{
System.out.println("Missing parameter");
System.out.println("1- Input file name ");
System.out.println("2- FromCode ");
System.out.println("3- ToCode ");
System.exit(0);
}
public static void main( String[] args )
{
if ( args.length < 3 ) {
help ();
}
new Conv_cp().recode(args[0] , args[1] , args[2] );
}
public void recode(String fnin, String cpf , String cpt)
{
final BufferedReader rin;
final BufferedWriter owt;
try
{
rin = new BufferedReader( new InputStreamReader(
/* getClass().getResourceAsStream( "temp.txt" ),
"ISO-8859-1" ));
owt = new BufferedWriter( new
OutputStreamWriter(System.out, "GB2312" ));
*/
getClass().getResourceAsStream( fnin ),cpf ));
owt = new BufferedWriter( new OutputStreamWriter(
System.out, cpt ));
}
catch ( IOException exc )
{
/* logger.error( exc ); */
return;
}
try
{
for ( String str; (str = rin.readLine()) != null; )
{
owt.write( str );
owt.newLine();
}
owt.flush();
}
catch ( IOException exc )
{
/* logger.error( exc ); */
}
finally
{
try
{
rin.close();
owt.close();
}
catch ( IOException exc )
{
/* logger.error( exc ); */
}
}
}
}