ASCII encoded unicode strings on web, such as \u00F3

igoryonya has asked for the wisdom of the Perl Monks concerning the following question:

When I send a POST request to a certain url, I get the string like that:
Compruebe si las direcciones URL que encontr\u00e9 en el archivo de configuraci\u00f3n son v\u00e1lidos

How do I decode strings, such as:
\u00e9
\u00f3
\u00e1

I've tried different things:

#It gives weird result:
$text =~ s/\\u(.{4})/pack('u', $1)/ge;
$text =~ s/\\u(.{4})/pack('U', $1)/ge;

#Says, nonnumeric argument:
$text =~ s/\\u(.{4})/pack('u', "0x$1")/ge;
$text =~ s/\\u(.{4})/pack('U', "0x$1")/ge;
$text =~ s/\\u(.{4})/chr("0x$1")/ge;

#Just stays as a changed string (\x{00e9}, \x{00f3}, \x{00e1},
#or with \0x{....}), doesn't interpolate:
$text =~ s/\\u(.{4})/\\x{$1}/g;
$text =~ s/\\u(.{4})/\\0x{$1}/g;

#does not change anything:
use Text::Unidecode;
$text =~ s/\\u(.{4})/unidecode($1)/ge;
[download]

How to convert those encoded strings to utf8 chars?

Comment on ASCII encoded unicode strings on web, such as \u00F3 Download Code

Replies are listed 'Best First'.
Re: ASCII encoded unicode strings on web, such as \u00F3 by shmem (Chancellor) on Jul 12, 2015 at 10:25 UTC
One way to do it: `$_= 'Compruebe si las direcciones URL que encontr\u00e9 en el archivo +de configuraci\u00f3n son v\u00e1lidos'; s/\\u(\w{4})/eval "\"\\x{$1}\""/ge; print;` [download] perl -le'print map{pack c,($-++?1:13)+ord}split//,ESEL'	[reply] [d/l]
Re^2: ASCII encoded unicode strings on web, such as \u00F3 by afoken (Chancellor) on Jul 12, 2015 at 15:22 UTC
`s/\\u(\w{4})/eval "\"\\x{$1}\""/ge;` Really? String eval and `\w`? You only want hex digits, not arbitary characters after `\u`. To make a character from a number written in hexadecimal, convert the number to decimal using hex, then convert that number to a character using chr. No need to torture perl with a string eval. `$_= 'Compruebe si las direcciones URL que encontr\u00e9 en el archivo +de configuraci\u00f3n son v\u00e1lidos'; s/\\u([0-9a-fA-F]{4})/chr hex $1/ge; print;` [download] Alexander -- Today I will gladly share my knowledge and experience, for there are no sweeter words than "I told you so". ;-)	[reply] [d/l] [select]
Re^3: ASCII encoded unicode strings on web, such as \u00F3 by shmem (Chancellor) on Jul 12, 2015 at 15:48 UTC
Really? String eval and \w? Yes. As stated, just one way to do it: \u0f00 => "\x{0f00}" => ༀ No need to torture perl with a string eval. Torture? String eval happens every time you use a module. Sometimes I just post TIMTOWTDI, since surely someone else will come up with a ( less odd \| cleaner \| more succinct \| better \| less costly ) way to do it. This time it has been you; Kudos ;-) perl -le'print map{pack c,($-++?1:13)+ord}split//,ESEL'	[reply]
Re^4: ASCII encoded unicode strings on web, such as \u00F3 by afoken (Chancellor) on Jul 12, 2015 at 22:31 UTC
Re^3: ASCII encoded unicode strings on web, such as \u00F3 by igoryonya (Pilgrim) on Jul 13, 2015 at 03:57 UTC
So, I am curious, since chr hex is more efficient, then eval, is pack('U', hex) more efficient then chr hex or vice versa?	[reply]
Re^4: ASCII encoded unicode strings on web, such as \u00F3 by shmem (Chancellor) on Jul 13, 2015 at 11:34 UTC
Re: ASCII encoded unicode strings on web, such as \u00F3 by Anonymous Monk on Jul 12, 2015 at 03:52 UTC
If by 'utf8 chars' you mean Perl strings, try this: `$text =~ s/ \\u ( \p{Hex}{4} ) / chr hex $1 /gex;` [download]	[reply] [d/l]
Re^2: ASCII encoded unicode strings on web, such as \u00F3 by igoryonya (Pilgrim) on Jul 12, 2015 at 10:03 UTC
What I mean is to convert ascii encoded unicode characters, as in my example, to normal unicode. For example (in bold are the ASCII encoded unicode chars): Compruebe si las direcciones URL que encontr\u00e9 en el archivo de configuraci\u00f3n son v\u00e1lidos I can't figure out how to convert those representations to normal characters. I tried your suggestion, it seems like, it just removes the following character :( Here is the result that I get, in comparison to the original string: Compruebe si las direcciones URL que encontr\u00e9 en el archivo de configuraci\u00f3n son v\u00e1lidos Compruebe si las direcciones URL que encontren el archivo de configuraci son vidos Here is what it shoud of been: Compruebe si las direcciones URL que encontré en el archivo de configuración son válidos	[reply]
Re^3: ASCII encoded unicode strings on web, such as \u00F3 by Anonymous Monk on Jul 12, 2015 at 14:38 UTC
Is your STDOUT in UTF-8 mode? (as in `binmode STDOUT, ':encoding(utf-8)`, for example). That's the way to get 'normal Unicode' in Perl. Does this work for you: `my $str = 'encontr\u00e9 configuraci\u00f3n v\u00e1lidod'; $str =~ s/ \\u ( \p{Hex}{4} ) / chr hex $1 /gex; binmode STDOUT, ':encoding(utf-8)'; print $str, "\n";` [download] ?	[reply] [d/l] [select]
Re^4: ASCII encoded unicode strings on web, such as \u00F3 by igoryonya (Pilgrim) on Jul 13, 2015 at 00:54 UTC


Perl: the Markov chain saw
	PerlMonks