Beefy Boxes and Bandwidth Generously Provided by pair Networks
P is for Practical

Re: Remove duplicate data from text file

by dragonchild (Archbishop)
on Nov 28, 2001 at 00:35 UTC ( #127903=note: print w/replies, xml ) Need Help??

in reply to Remove duplicate data from text file

  1. Read the file into an array
  2. Create a hash whose keys are the values in the array
  3. Create an array from the keys of the hash
  4. Print the array out to a file
The details are left as an exercise for the reader.

We are the carpenters and bricklayers of the Information Age.

Don't go borrowing trouble. For programmers, this means Worry only about what you need to implement.

  • Comment on Re: Remove duplicate data from text file

Replies are listed 'Best First'.
by ggoebel (Sexton) on Nov 28, 2001 at 01:31 UTC
    my $filename = ...; local $/; open IN, $filename; $text = <IN>; @words{split /\s+/, $text} = undef; @words = keys %words;

Log In?

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://127903]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others perusing the Monastery: (3)
As of 2023-03-20 09:10 GMT
Find Nodes?
    Voting Booth?
    Which type of climate do you prefer to live in?

    Results (59 votes). Check out past polls.