Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Java convert character stream into human "readable" String

I have a bunch of characters with that looks something like this:

Комуникационна кабелна система

and sometimes I have a mix like this:

Généralités

The first translates into :

Комуникационна кабелна система

and the second to:

Généralités

I can see this using a browser and place them into the body.

But how can I make java output the "real" characters ? What is the above encoding called?

I have tried a couple of things, and lastly this ( which did not work ):

import java.nio.charset.*;
import java.nio.ByteBuffer;
import java.nio.CharBuffer;

List<String> lst = new ArrayList<String>(); lst.add("&#1050;"); lst.add("&#1086;");
for ( String s : lst ) {

    Charset utf8charset = Charset.forName("UTF-8");
    Charset iso88591charset = Charset.forName("ISO-8859-1");

    ByteBuffer inputBuffer = ByteBuffer.wrap( s.getBytes() );

    // decode UTF-8
    CharBuffer data = utf8charset.decode(inputBuffer);

    // encode ISO-8559-1
    ByteBuffer outputBuffer = iso88591charset.encode(data);
    byte[] outputData = outputBuffer.array();

    System.out.println ( new String(outputData) )
}
like image 882
mjs Avatar asked Mar 14 '12 14:03

mjs


1 Answers

You can use commons-lang to unescape this sort of thing. In Groovy:

@Grab( 'commons-lang:commons-lang:2.6' )
import org.apache.commons.lang.StringEscapeUtils as SEU

def str = 'G&#233;n&#233;ralit&#233;s'

println SEU.unescapeHtml( str )
like image 195
tim_yates Avatar answered Sep 22 '22 19:09

tim_yates