Would it be an option to do something like:

$a="/my/module/path";
eval "use lib '$a'";
eval { use MyModule; }
[download]

I recall once using eval & use together to dynamically load specific modules when needed... This was before I knew about AUTOLOAD and SelfLoader and all...