Beefy Boxes and Bandwidth Generously Provided by pair Networks
Clear questions and runnable code
get the best and fastest answer
 
PerlMonks  

Re: Perl Program to efficiently process 500000 small files in a Directory (AIX)

by LanX (Saint)
on Mar 17, 2018 at 14:10 UTC ( [id://1211136]=note: print w/replies, xml ) Need Help??


in reply to Perl Program to efficiently process 500000 small files in a Directory (AIX)

Provided there are no unidentified bottlenecks in your code.
  • How busy is your system/ processes/ nice level?
  • Is your filesystem under heavy load?
  • Did you try to run parallel scripts, dedicated to separated file names?

Cheers Rolf
(addicted to the Perl Programming Language and ☆☆☆☆ :)
Wikisyntax for the Monastery

  • Comment on Re: Perl Program to efficiently process 500000 small files in a Directory (AIX)

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://1211136]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others taking refuge in the Monastery: (2)
As of 2024-04-25 05:24 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found