Does it means I should give up trying CavaPackager?

I think that the answer to that depends on what version and distribution of Perl you want to use.

For whatever reason, it looks like development on Cava Packager stopped and the latest Perl version that it supports is 5.16. So if you want to use a newer version of Perl (and/or if the module versions that you want to use require a newer version of Perl), you might not be able to get Cava Packager to work. And although the developers recommend using Citrus Perl, they do note that "other builds and distributions of Perl may also work". So if you use a build/distribution of Perl that is not compatible with Cava Packager, you might not be able to get it to work.

If you're looking for a free alternative to Cava Packager, you could look into the pp utility from PAR::Packer. And in case you ever needed to bundle Perl code into an executable on Windows, salva has released Win32::Packer. I haven't tried Win32::Packer yet, but I've been wanting to.

Of course there are other utilities that you could purchase to bundle your Perl code into an executable. I won't name any here, but you could easily search for those if you really wanted/needed to go that route.