You could try to repeat the CPAN build process manually. Whenever CPAN build fails, I will chdir to ~/.cpan/build/<moudle> directory, then do a manual build under that directory by:

perl Makefile.PL
make | tee make.log
make test

This will always give me warm and fuzzy feeling that I am in control, and it will always give me (or enable me to find out) the precise reason of build failure. You may either need to 'sudo' the make process, or to reset the owner/group of your 'stuffed-by-sudo' CPAN build directories.