Beefy Boxes and Bandwidth Generously Provided by pair Networks
Keep It Simple, Stupid
 
PerlMonks  

Re: Faster Method for Gathering Data

by dga (Hermit)
on Jul 31, 2003 at 17:27 UTC ( [id://279670]=note: print w/replies, xml ) Need Help??


in reply to Faster Method for Gathering Data

Another possibility which may not apply in your situation is to run a straight recursive directory listing into a text file then write a perl script to parse that.

The fastest of course would be to run the listing on the remote machine and then transfer the listing file to the local machine.

Second fastest might be to do the listing over the network and save the output locally and run a parsing script on that. Of course if an over the network directory listing takes 5 hours to complete you don't save a lot of time.

use strict; while(<>) { push(@files) if /\.sgml$/; }

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://279670]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others browsing the Monastery: (8)
As of 2024-04-23 08:26 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found