Beefy Boxes and Bandwidth Generously Provided by pair Networks
P is for Practical
 
PerlMonks  

Re: Remove duplicate data from text file

by dragonchild (Archbishop)
on Nov 28, 2001 at 00:35 UTC ( #127903=note: print w/replies, xml ) Need Help??


in reply to Remove duplicate data from text file

  1. Read the file into an array
  2. Create a hash whose keys are the values in the array
  3. Create an array from the keys of the hash
  4. Print the array out to a file
The details are left as an exercise for the reader.

------
We are the carpenters and bricklayers of the Information Age.

Don't go borrowing trouble. For programmers, this means Worry only about what you need to implement.

  • Comment on Re: Remove duplicate data from text file

Replies are listed 'Best First'.
Code
by ggoebel (Sexton) on Nov 28, 2001 at 01:31 UTC 
    my $filename = ...;
local $/;
open IN, $filename;
$text = <IN>;
@words{split /\s+/, $text} = undef;
@words = keys %words;

    [download]
[reply]
[d/l]

In Section Seekers of Perl Wisdom

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?

www.com | www.net | www.org
Node Status?
node history
Node Type: note [id://127903]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others perusing the Monastery: (3)
As of 2023-03-20 09:10 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Which type of climate do you prefer to live in?






    Results (59 votes). Check out past polls.
    Notices?