Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl: the Markov chain saw
 
PerlMonks  

Re^2: Perl solution for storage of large number of small files

by isync (Hermit)
on Apr 30, 2007 at 10:48 UTC ( #612737=note: print w/replies, xml ) Need Help??


in reply to Re: Perl solution for storage of large number of small files
in thread Perl solution for storage of large number of small files

32 chars names, lookup is always by name, full reads no seeks inside.

Files can be everything from 5-500K of data...

Concurrent writes to the storage, but never on the same file (as everything is passed through an index, serializing events, see above reply)

Sounds like you have an interesting solution in mind...
(This thread is becoming a fun-discussion, not only solving my problem but thinking about data-mining in general)
  • Comment on Re^2: Perl solution for storage of large number of small files

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://612737]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others examining the Monastery: (4)
As of 2022-08-08 07:35 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found

    Notices?