The approach I'm leaning toward at this point is to just mirror CPAN locally, use either a bundle file or write a script that uses CPAN.pm to do the installation of all the modules of specified revisions from a list, and write several scripts, 1) to compare listed modules against the repository to see if new revisions have been released and 2) given a module that is out of date in my local repository, be able to pull the new version down from CPAN into the local repository.

Something else mentioned in the mod_perl thread was conversion of modules to RPMs for deployment. That approach looks interesting and provides the ability to query the rpm database to find out what versions of what modules are installed and the ability to uninstall modules, but it also adds a complexity that I think is beyond what is needed at this point in this project.