Beefy Boxes and Bandwidth Generously Provided by pair Networks
P is for Practical
 
PerlMonks  

Re: HTML::Strip and UTF8 -- is there some way I can just skip all the "UTF8 only" entities?

by wfsp (Abbot)
on Jan 03, 2007 at 20:22 UTC ( [id://592826]=note: print w/replies, xml ) Need Help??


in reply to HTML::Strip and UTF8 -- is there some way I can just skip all the "UTF8 only" entities?

Problem I'm having is html that has exotic characters like:
’
A possible source of such exoticism is MS and their use of x80-x9F for such characters (a range not used by either Latin1 or utf8). After a round trip through something like HTML::Entities they come back as a utf8 equivalent (e.g. 0x201C).

I've had several runs round the block with this myself.
See Fixing suspect characters in HTML for a possible approach.

Hope that helps.

  • Comment on Re: HTML::Strip and UTF8 -- is there some way I can just skip all the "UTF8 only" entities?
  • Download Code

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://592826]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others meditating upon the Monastery: (5)
As of 2024-04-19 02:36 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found