My test suite takes about 6 minutes to run. Most of the time, I'm testing things that haven't changed.

Is  make the tool to run my tests faster?

Does a script to regenerate my makefile already exist?

Translating My::Foo:Thing to 'lib/Foo/Thing.pm' doesn't look very hard. The Test::WWW::Mechanize tests aren't as obvious but eyebballing the output from Devel::NYTProf or Devel::Cover would be a start

Obviously  make clean would be a good idea before pushing to production