Logo Questions Linux Laravel Mysql Ubuntu Git Menu
HTML CSS JAVASCRIPT SQL PYTHON PHP BOOTSTRAP JAVA JQUERY R React Kotlin
 

iconv: Convert from CP1252 to UTF-8

Tags:

iconv

I'm trying to convert the CP1252 encoded string Çàïèñêè ýêñïåäèòîðà to UTF-8. I have tried this command:

iconv -c -f=WINDOWS-1252 -t=UTF-8 test.txt

No luck, getting some weird results:

ÊÀÇÀÃÃœ ÃÎÂÛÉ ÂÅÊ

I tried entering the same string (Çàïèñêè ýêñïåäèòîðà) here, and they are able to convert it without problems: http://www.artlebedev.ru/tools/decoder/

What is going wrong?

like image 431
Somebody Avatar asked Mar 15 '13 00:03

Somebody

People also ask

Is CP1252 a subset of UTF-8?

Windows-1252 is a subset of UTF-8 in terms of 'what characters are available', but not in terms of their byte-by-byte representation. Windows-1252 has characters between bytes 127 and 255 that UTF-8 has a different encoding for.

How do you convert to UTF?

Click Tools, then select Web options. Go to the Encoding tab. In the dropdown for Save this document as: choose Unicode (UTF-8). Click Ok.

1 Answers

My solution:

iconv -f windows-1252 -t utf-8 in.file -o out.file
like image 117
Java Dude Avatar answered Sep 20 '22 16:09

Java Dude
Sign in to Comment

Related questions

How to detect invalid html entities in PHP?
Removing invalid/incomplete multibyte characters
PHP compile fails with undefined symbols for architecture x86_64, libiconv on macOS Sierra
PHP iconv_strlen() meaning question
Why can iconv convert precomposed form but not decomposed form of "É" (from UTF-8 to CP1252)
PHP, convert UTF-8 to ASCII 8-bit
How can I force PHP to use the libiconv version of iconv instead of the CentOS-installed glibc version?
Debug iconv_strlen error - PHP 5.5
Ruby converting string encoding from ISO-8859-1 to UTF-8 not working
What factors influence a successful iconv() TRANSLIT conversion?
iconv or mbstring?
Unaccent string in bash script (RHEL)
Convert Javascript UTF-8 to ASCII (like Iconv('UTF-8', 'ASCII//TRANSLIT', $string) in PHP)
How to do an accent insensitive grep?
iconv_strlen function causing execution timeout, running on MAMP
Equivalent of Iconv.conv("UTF-8//IGNORE",...) in Ruby 1.9.X?
Convert UTF-16LE to UTF-8 in php
Using iconv to convert from UTF-16BE to UTF-8 without BOM
Converting a \u escaped Unicode string to ASCII

Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!