Re: Troubleshoot a path problem when multithreading on cluster

in reply to Troubleshoot a path problem when multithreading on cluster

Hello and welcome to the monastery.

"File write error" looks very suspicious if all its doing is trying to find a module. What exactly did you do in your "single task on single thread" test that worked? How was the code different than the code that is failing?

Comment on Re: Troubleshoot a path problem when multithreading on cluster

Replies are listed 'Best First'.
Re^2: Troubleshoot a path problem when multithreading on cluster by wayne_deng2000 (Initiate) on Nov 10, 2014 at 02:38 UTC
I guess "File writing error" is due to messy data not parsed properly by parser module. Two runs I tested use almost same perl code (except a bit difference for multi-task requiring a submission script (batch jobs in PBS manager). Forgot to mention that XML::Parser also requires another Expat library (.so) to work properly. Just suspect that PBS cluster manager ignored the path in ENV or something related to dynamic library? tried to set ld_Library_Path in script, so far the error still persists. Any input is appreciated.	[reply]

Replies are listed 'Best First'.

Re^2: Troubleshoot a path problem when multithreading on cluster
by wayne_deng2000 (Initiate) on Nov 10, 2014 at 02:38 UTC

I guess "File writing error" is due to messy data not parsed properly by parser module. Two runs I tested use almost same perl code (except a bit difference for multi-task requiring a submission script (batch jobs in PBS manager). Forgot to mention that XML::Parser also requires another Expat library (.so) to work properly. Just suspect that PBS cluster manager ignored the path in ENV or something related to dynamic library? tried to set ld_Library_Path in script, so far the error still persists. Any input is appreciated.

[reply]

In Section Seekers of Perl Wisdom