I put something in to log calls to destructors. I also "stub out" parts to see if the leak goes away.

FYI, a fairly recently found bug is that Perl creates a circular reference when it creates a closure, so creating closures leaks memory. I think this has been fixed but that no released version of Perl contains the fix yet.