http://qs321.pair.com?node_id=1230688


in reply to Re^2: truncate string to byte count
in thread truncate string to byte count

For example, passing a string consisting of characters 80 and 80 with a second argument of 2 will can [sic] result in "\x80" (correct) and "\x80\x80" (incorrect).

The way you've worded this makes it sound like the output is not deterministic, which is certainly not the case. Also, "a string consisting of characters 80 and 80" is not specific enough for a test case. But please feel free to provide some actual test code that demonstrates the bug you are trying to explain, or better yet, show how you would've coded it to (at least in your view) "correctly" handle the different strings "\x80\x80" and "\N{U+80}\N{U+80}".

Replies are listed 'Best First'.
Re^4: truncate string to byte count
by ikegami (Patriarch) on Feb 28, 2019 at 21:09 UTC

    But please feel free to provide some actual test code that demonstrates the bug

    Code that suffers from The Unicode Bug is code that returns different results for equal strings. This is easily demonstrated using the following: 

    my $s = "\x80\x80";
utf8::upgrade(   my $u = $s );
utf8::downgrade( my $d = $s );

is($u, $d);
is(utf8cut($u,2), utf8cut($d,2));

    [download]

    better yet, show how you would've coded it to (at least in your view) "correctly" handle the different strings "\x80\x80" and "\N{U+80}\N{U+80}".

    Perl considers those the same value, and any code that doesn't is by definition suffering from The Unicode Bug.

[reply]
[d/l]

In Section Seekers of Perl Wisdom