Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl: the Markov chain saw
 
PerlMonks  

Re^2: use locale broken?

by december (Pilgrim)
on Mar 17, 2011 at 18:01 UTC ( #893824=note: print w/replies, xml ) Need Help??


in reply to Re: use locale broken?
in thread use locale broken?

I was hoping to have it work both when the user (shell) encoding is in either ISO-8859-1 or UTF-8. Maybe I'm better off forcefully converting all input and output to UTF-8 and have the code itself dealing with UNICODE only.

I still feel this is a bug in Perl, though.

Is there a way perhaps debugging argument to see what \w applies to?

Replies are listed 'Best First'.
Re^3: use locale broken? (\w)
by ikegami (Patriarch) on Mar 17, 2011 at 19:12 UTC

    Maybe I'm better off forcefully converting all input and output to UTF-8

    Yes. For many reasons, it is best to decode all inputs, and encode all output.

    I still feel this is a bug in Perl, though.

    I believe Perl doesn't support multi-byte locales (e.g. UTF-8).

    Effort is placed on Unicode instead instead of adding to the locale system.

    Is there a way perhaps debugging argument to see what \w applies to?

    perlre: Match a "word" character (alphanumeric plus "_").

    The following are equivalent:

    ( No, this is wrong )

    /\w/ # When no locale, when not restricted to ASCII /\p{Word}/ /[_\p{Alnum}]/ /[_\p{Alphabetic}\p{Nd}]/

    Derived property "Alphabetic". (100,520 codepoints in Perl 5.12.2)
    Unicode character category "Nd". (411 codepoints in Perl 5.12.2)

    Actual lists vary by version of Unicode and thus by version of Perl.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://893824]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others taking refuge in the Monastery: (8)
As of 2022-01-21 12:37 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    In 2022, my preferred method to securely store passwords is:












    Results (57 votes). Check out past polls.

    Notices?