Beefy Boxes and Bandwidth Generously Provided by pair Networks
more useful options
 
PerlMonks  

Re: Re: Re: Tracking Memory Leaks

by dragonchild (Archbishop)
on Aug 15, 2001 at 02:19 UTC ( [id://104897]=note: print w/replies, xml ) Need Help??


in reply to Re: Re: Tracking Memory Leaks
in thread Tracking Memory Leaks

To reply to a few points:
  1. Be very careful. Simply because something is out of scope does not mean that it's been garbage-collected. Directly from the Camel (3rd ed., p.223):

    Lexical variables don't get automatically garbage collected just because their scope has exited; they wait to get recycled until they're no longer used, which is muych more important. To create private variables ...

    I would suspect that this is a minor problem, but probably not the whole issue.

  2. As for the constantly loaded classes ... I'm going to guess that you're creating the classes using some sort of AUTOLOAD(), eval, or combination of the two. If that's the case, these classes are probably taking quite a chunk of memory. Now, by doing it this way, you're taking away any possible compile-time optimizations that the compiler could do. In addition, I think that once you use AUTOLOAD() once, the compiler will allocate additional memory every time, just as if you used $` or $' in regexps.

    I think that this is the culprit. I would suspect that it's not that you're loading 10^12 classes, but that each class is taking a bigger chunk than you realize.

------
/me wants to be the brightest bulb in the chandelier!

Vote paco for President!

Replies are listed 'Best First'.
Re: Re: Re: Re: Tracking Memory Leaks
by Hrunting (Pilgrim) on Aug 15, 2001 at 20:58 UTC
    How does the interpreter determine whether a lexical is no longer "used"? You have to explicitly set it to undef? That seems doesn't seem like too much a "feature". So my memory usage won't really top out until all my functions have been called and all my variables used, is that correct?

    I didn't know that about AUTOLOAD(). What do you mean by 'allocate additional memory every time'? Does that mean that every time I effectively call AUTOLOAD() (In my case, once for each undeclared function as I use AUTOLOAD() to then declare the function), the interpreter allocates a chunk of memory, or just that everytime I load a module with an AUTOLOAD() in it, it will allocate a larger chunk of memory than it would for a regular module? I know I miss out on compile-time optimizations for the system, but do those optimizations involve the re-use of resources, as opposed to the allocation of resources (which I know they involve)? I would expect that resource re-use would be a function of the running system, not the compile-time optimizations. If perl allocates memory for eval'd statements and AUTOLOAD()ed subroutines and then doesn't re-use it, that sounds like a pretty serious issue.

      I don't know what exactly dragonchild was referring to, except that if you create methods or classes on the fly, that's going to consume memory. No more so than if you'd put the same definitions in a .pm file and use'd it, though. I don't think AUTOLOAD or eval("string") themselves leak memory. And I don't know what "compile time optimizations" he was referring to; eval is as much compile time as what you get when you load your main program or use/require'd modules.
        With regards to the interpreter knowing when a lexical is no longer used ... I have no idea. Anyone know?

        With regards to the memory consumption of classes/methods created on the fly ... I thought that it would use more RAM. However, I didn't test it, so I don't know. It would be an interesting thing to benchmark. I would think that it would take more CPU, though. However, I don't know for sure. It's more of a hunch that anything else.

        ------
        /me wants to be the brightest bulb in the chandelier!

        Vote paco for President!

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://104897]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others imbibing at the Monastery: (4)
As of 2024-04-25 02:24 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found