Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl: the Markov chain saw
 
PerlMonks  

Re^3: use locale broken? (\w)

by ikegami (Patriarch)
on Mar 17, 2011 at 19:12 UTC ( [id://893838]=note: print w/replies, xml ) Need Help??


in reply to Re^2: use locale broken?
in thread use locale broken?

Maybe I'm better off forcefully converting all input and output to UTF-8

Yes. For many reasons, it is best to decode all inputs, and encode all output.

I still feel this is a bug in Perl, though.

I believe Perl doesn't support multi-byte locales (e.g. UTF-8).

Effort is placed on Unicode instead instead of adding to the locale system.

Is there a way – perhaps debugging argument – to see what \w applies to?

perlre: Match a "word" character (alphanumeric plus "_").

The following are equivalent:

( No, this is wrong )

/\w/ # When no locale, when not restricted to ASCII /\p{Word}/ /[_\p{Alnum}]/ /[_\p{Alphabetic}\p{Nd}]/

Derived property "Alphabetic". (100,520 codepoints in Perl 5.12.2)
Unicode character category "Nd". (411 codepoints in Perl 5.12.2)

Actual lists vary by version of Unicode and thus by version of Perl.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://893838]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others taking refuge in the Monastery: (7)
As of 2024-04-23 13:10 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found