Почему не работает translit в bash?

Question

[Сергей Бурдужа]

Всем привет.
Почему не работает этот код?

❯ echo "какой-то текст" | iconv -f utf-8 -t ascii//TRANSLIT
?????-?? ?????

Что за знаки вопроса и как исправить?

Answer 1

[ky0]

Please note that iconv('UTF-8', 'ASCII//TRANSLIT', ...) doesn't work properly when locale category LC_CTYPE is set to C or POSIX. You must choose another locale otherwise all non-ASCII characters will be replaced with question marks. This is at least true with glibc 2.5.

https://www.php.net/manual/en/function.iconv.php

Comments

[Сергей Бурдужа]

Вроде бы lC_TYPE не C и не POSIX, или я что-то путаю?

❯ locale
LANG=ru_RU.UTF-8
LANGUAGE=ru
LC_CTYPE="ru_RU.UTF-8"
LC_NUMERIC="ru_RU.UTF-8"
LC_TIME="ru_RU.UTF-8"
LC_COLLATE="ru_RU.UTF-8"
LC_MONETARY="ru_RU.UTF-8"
LC_MESSAGES="ru_RU.UTF-8"
LC_PAPER="ru_RU.UTF-8"
LC_NAME="ru_RU.UTF-8"
LC_ADDRESS="ru_RU.UTF-8"
LC_TELEPHONE="ru_RU.UTF-8"
LC_MEASUREMENT="ru_RU.UTF-8"
LC_IDENTIFICATION="ru_RU.UTF-8"
LC_ALL=
❯ export LC_ALL=ru_RU.UTF-8
❯ locale
LANG=ru_RU.UTF-8
LANGUAGE=ru
LC_CTYPE="ru_RU.UTF-8"
LC_NUMERIC="ru_RU.UTF-8"
LC_TIME="ru_RU.UTF-8"
LC_COLLATE="ru_RU.UTF-8"
LC_MONETARY="ru_RU.UTF-8"
LC_MESSAGES="ru_RU.UTF-8"
LC_PAPER="ru_RU.UTF-8"
LC_NAME="ru_RU.UTF-8"
LC_ADDRESS="ru_RU.UTF-8"
LC_TELEPHONE="ru_RU.UTF-8"
LC_MEASUREMENT="ru_RU.UTF-8"
LC_IDENTIFICATION="ru_RU.UTF-8"
LC_ALL=ru_RU.UTF-8

[Сергей Бурдужа]

Переустановил и использовал все эти локали но не помогло

❯ locale -a | grep ru
ru_RU
ru_RU.cp1251
ru_RU.iso88595
ru_RU.koi8r
ru_RU.utf8
russian
ru_UA.utf8
❯ export LC_ALL=ru_RU.koi8r
❯ echo "какой-то текст" | iconv -f utf-8 -t ascii//TRANSLIT
?????-?? ?????
❯ export LC_ALL=ru_RU.iso88595
❯ locale
LANG=en_US.UTF-8
LANGUAGE=en
LC_CTYPE="ru_RU.iso88595"
LC_NUMERIC="ru_RU.iso88595"
LC_TIME="ru_RU.iso88595"
LC_COLLATE="ru_RU.iso88595"
LC_MONETARY="ru_RU.iso88595"
LC_MESSAGES="ru_RU.iso88595"
LC_PAPER="ru_RU.iso88595"
LC_NAME="ru_RU.iso88595"
LC_ADDRESS="ru_RU.iso88595"
LC_TELEPHONE="ru_RU.iso88595"
LC_MEASUREMENT="ru_RU.iso88595"
LC_IDENTIFICATION="ru_RU.iso88595"
LC_ALL=ru_RU.iso88595
❯ echo "какой-то текст" | iconv -f utf-8 -t ascii//TRANSLIT
?????-?? ?????
❯ export LC_ALL=ru_RU
❯ locale
LANG=en_US.UTF-8
LANGUAGE=en
LC_CTYPE="ru_RU"
LC_NUMERIC="ru_RU"
LC_TIME="ru_RU"
LC_COLLATE="ru_RU"
LC_MONETARY="ru_RU"
LC_MESSAGES="ru_RU"
LC_PAPER="ru_RU"
LC_NAME="ru_RU"
LC_ADDRESS="ru_RU"
LC_TELEPHONE="ru_RU"
LC_MEASUREMENT="ru_RU"
LC_IDENTIFICATION="ru_RU"
LC_ALL=ru_RU
❯ echo "какой-то текст" | iconv -f utf-8 -t ascii//TRANSLIT
?????-?? ?????

[arto]

# echo "какой-то текст" | LC_ALL=POSIX iconv -c -f utf-8 -t ascii//TRANSLIT
kakoj-to tekst