Beefy Boxes and Bandwidth Generously Provided by pair Networks
Think about Loose Coupling

Re^2: Memory is not released back to operating system

by bloonix (Monk)
on Mar 03, 2012 at 00:22 UTC ( #957572=note: print w/replies, xml ) Need Help??

in reply to Re: Memory is not released back to operating system
in thread Memory is not released back to operating system

Forking... that is exactly my problem.

My daemon process needs a lot of memory (~2-8GB) for different data. Every time the daemon forks some new processes to distribute its work, each child process has the same size, but each child process needs only a lower part (~20MB) of the data. I thought it could be possible at first to destroy the object and release the memory back to the OS and then send the lower part over a pipe to the child process. The idea was really bad.

> fork the code off

I could fork the memory off.

I think I have no other chance as to fork a process that holds the data and distribute the workload to other child processes. The main daemon just managing the forking machine without the huge amount of data.

Thanks for the inspiration!

  • Comment on Re^2: Memory is not released back to operating system

Replies are listed 'Best First'.
Re^3: Memory is not released back to operating system
by shawnhcorey (Friar) on Mar 03, 2012 at 16:49 UTC

    The usual implementation is to have a small controller section of code that forks off the workload onto its child processes. Try to keep you memory footprint of the controller as small as possible. Both the controller section and the worker section are often included in the same binary or script, so that if you have one, you have everything you need to run.

    If you are writing a true daemon, have it die and restart periodically. This will get rid of unused memory, open files and sockets, and zombie children that were never harvested. This is usually done by having an entry in the appropriate /etc/rc file.

Log In?

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://957572]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others browsing the Monastery: (3)
As of 2023-05-29 04:49 GMT
Find Nodes?
    Voting Booth?

    No recent polls found