Beefy Boxes and Bandwidth Generously Provided by pair Networks
Welcome to the Monastery
 
PerlMonks  

Re^4: Multi threading

by sandy1028 (Sexton)
on Apr 13, 2009 at 09:20 UTC ( [id://757185]=note: print w/replies, xml ) Need Help??


in reply to Re^3: Multi threading
in thread Multi threading

sub processdir(){ my $pm = new Parallel::ForkManager(5); $pm->run_on_finish( sub { my ($pid, $exit_code, $ident) = @_; $tmp +Files[$ident] = undef; } ); foreach my $i (0..$#Files) { # Forks and returns the pid for the child: my $pid = $pm->start($i) and next; $SIG{INT} = 'DEFAULT'; my $filename = $Files[$i]->filename(); my $file = IO::File->new("<$filename") or die "Can't open $filen +ame\n"; while((my $line) = $file->getline()) { last unless defined($line); chomp $line; my ($dir, $file) = split(/\t/, $line); $processor->($dir, $file, $config, $log); } $pm->finish; # Terminates the child process } $pm->wait_all_children; return; } processdir($input_dir,$logfile,\&clean_value); sub clean_value(){ $logfile->print("-- Reading '$input_file' file\n"); }
Here all the process executes,writes together and input file name overlaps in the file name
How to avoid overlapping of file names into the $logfile.
In which portion should I use locks or how to avoid averlapping of filename

Replies are listed 'Best First'.
Re^5: Multi threading
by sandy1028 (Sexton) on Apr 15, 2009 at 08:36 UTC
    Can anyone please tell me how to create the threads for
    reading all the files from directories and sub-directories and write to the one log file or create a separate log file for each thread, without using sleep()
    Each thread should process(read ) 100 files at a time.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://757185]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others pondering the Monastery: (5)
As of 2024-04-19 04:47 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found