Beefy Boxes and Bandwidth Generously Provided by pair Networks
go ahead... be a heretic
 
PerlMonks  

Re^9: Math::GSL::SparseMatrix is broken if installed on latest 5.32.1.1 "Strawberry Perl PDL edition", whom to report this issue to? [OT]

by Anonymous Monk
on Nov 15, 2022 at 22:34 UTC ( [id://11148194]=note: print w/replies, xml ) Need Help??


in reply to Re^8: Math::GSL::SparseMatrix is broken if installed on latest 5.32.1.1 "Strawberry Perl PDL edition", whom to report this issue to?
in thread Math::GSL::SparseMatrix is broken if installed on latest 5.32.1.1 "Strawberry Perl PDL edition", whom to report this issue to?

I don't see a good reason that the 4th run should blow up

No more virtual memory? 10% non-zero elements are assumed by default. Auto managed PF is 3 x RAM max. I see "Commit size" close to 30 GB for process when gsl_spmatrix_alloc(80000,80000), can go no further. My 8 GB RAM (less than 6 is free) + 24 GB PF sums up OK to this "30". My guess is you have 16 GB + same auto-managed PF, and "Commit size" would be ~56 GB or so for 95K by 95K matrix.

  • Comment on Re^9: Math::GSL::SparseMatrix is broken if installed on latest 5.32.1.1 "Strawberry Perl PDL edition", whom to report this issue to? [OT]
  • Download Code

Replies are listed 'Best First'.
Re^10: Math::GSL::SparseMatrix is broken if installed on latest 5.32.1.1 "Strawberry Perl PDL edition", whom to report this issue to? [OT]
by syphilis (Archbishop) on Nov 16, 2022 at 06:05 UTC
    No more virtual memory?

    Ok - that would mean that "there are some mysterious rules of usage that I am overlooking".
    In fairness to them, perhaps that's not at all "mysterious" - but I wasn't expecting that sufficient memory would be allocated to actually store so many zeros.

    Thanks for the discussion.
    It was interesting to poke at (part of) the GSL library again.

    Cheers,
    Rob

      In fairness, it's not space for zeros which is allocated, but data, i, p (each 10% of total), and AVL tree. E.g. 40K x 40K matrix of type double would require ~12.8 GB of dense storage, but ~7.5 GB (checked "Commit size") of sparse COO storage. I agree it's unexpectedly very much. If I change density to 20%, then value goes up to ~15 GB. Already more than for dense matrix. Well, for my initial purposes of "very large 64-bit indexes" actual population would be very low. Sorry to continue after discussion seemingly was supposed to end :)

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://11148194]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others admiring the Monastery: (4)
As of 2024-04-25 22:30 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found