Anonymous Monk has asked for the wisdom of the Perl Monks concerning the following question:
Hi there, Im trying to increase the capacity of the shared variables of my webcrawler as I'm goind to index million of urls and the number of data shared will grow very fast.
I'm using forks shared, but I'm looking for something which can keep the more used on memory and the less used on disk, with this in mind I looked for berkeleydb, but forksberkeleydb dont worked the way I was waiting, It always crash when I try to insert hash of hashes or array of hashes, so it's useless for my intention.
Some of you monks here a suggestion to solve my problem?
Thanks
|