and shows that you didn't read the whole of perlsec, nor even the few paragraphs in the section called Cleaning Up Your Path

I did!
I put the delete in. Once the error had gone I commented that line out to see if it was necessary and the error did not return. Hence why I didn't include it in the code snippet.

I think that Corion's advice...

Good advice it may be. But on this shared hosting (you remembered correctly) it didn't work - Re^2: Insecure CPAN module in taint mode