how to use sed delete Unicode in some range?

Question

I want to remove Unicode in some range, e.g.:

echo "abcＡＢＣ123" | sed 's/[\uff21-\uff3b]//g'

expect "abc123", but get:

sed: -e expression #1, char 20: Invalid range end

or use:

echo "abcＡＢＣ123" | sed 's/[Ａ-Ｚ]//g'

get:

sed: -e expression #1, char 14: Invalid collation character

Answer 1

Unicode support in sed is not well defined. You may be better off using command line perl:

echo "abcＡＢＣ123" | perl -CS -pe 's/[\x{FF21}-\x{FF3B}]+//g'

abc123

It is important to use -CS flags here to be able to get correct UTF8 encodings for input/output/error.