Beefy Boxes and Bandwidth Generously Provided by pair Networks
We don't bite newbies here... much
 
PerlMonks  

Re: Problem in RAM usage while threading the program

by Anonymous Monk
on Dec 20, 2019 at 00:43 UTC ( #11110406=note: print w/replies, xml ) Need Help??


in reply to Problem in RAM usage while threading the program

Quite honestly ... you're just going to have to re-think your strategy here. Your "100GB of sequences" is very-obviously a database, not any sort of reasonable "in-memory data structure," no matter how much memory your machine has, nor how many simultaneous threads (why?) you are now attempting to run.
  • Comment on Re: Problem in RAM usage while threading the program

Replies are listed 'Best First'.
Re^2: Problem in RAM usage while threading the program
by soonix (Canon) on Dec 20, 2019 at 08:05 UTC
    While it is certainly true that OP's "sequences" are kind of a database¹, it might be problematic to put them into a database². Of course, once this task is accomplished, it mainly depends on the database³ whether or not threading would help.
    database
    1. (general) A collection of (usually) organized information in a regular structure, usually but not necessarily in a machine-readable format accessible by a computer.
    2. (computing) A set of tables in a database(1).
    3. (computing) A software program for storing, retrieving and manipulating a database(1).
Re^2: Problem in RAM usage while threading the program
by eyepopslikeamosquito (Bishop) on Dec 20, 2019 at 12:21 UTC
Re^2: Problem in RAM usage while threading the program
by Anonymous Monk on Dec 20, 2019 at 02:14 UTC
    Shhh

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://11110406]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others wandering the Monastery: (4)
As of 2020-10-22 20:58 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    My favourite web site is:












    Results (230 votes). Check out past polls.

    Notices?