Beefy Boxes and Bandwidth Generously Provided by pair Networks
The stupid question is the question not asked
 
PerlMonks  

Re^4: fast disk db with bulk insert, fast read access, compact storage

by iaw4 (Monk)
on Sep 18, 2010 at 22:27 UTC ( [id://860661]=note: print w/replies, xml ) Need Help??


in reply to Re^3: fast disk db with bulk insert, fast read access, compact storage
in thread fast disk db with bulk insert, fast read access, compact storage

actually, I think the db descriptions are pretty much the same (5GB for testing now, 20GB in the future, so 32GB is a good upper limit), although neither description was very good. however, what is very good is that you told me what it is that I am really looking for: an inverted index. thanks a lot. very helpful. I should be able to search for this now in a much more intelligent fashion.

so I need a nice, fast inverted index program for ubuntu perl. knowing what I need, I could now search cpan. as luck would have it, Search::Moose seems to be designed for this sort of job. (as bad luck would have it, it aborts during the build stage on my ubuntu machine. if someone knows more about Search::Moose, please let me know.)

thanks a lot, everybody.

regards, /iaw

Replies are listed 'Best First'.
Re^5: fast disk db with bulk insert, fast read access, compact storage
by BrowserUk (Patriarch) on Sep 19, 2010 at 07:37 UTC
    I think the db descriptions are pretty much the same

    I guess we read different things.

    as luck would have it, Search::Moose seems to be designed for this sort of job.

    Hm. cpan didn't show up anything when I searched for Search::Moose.

    And, if you're looking for "blindingly fast", anything with "Moose" in the title probably isn't going to cut it.


    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.

      :-)

      I meant Search::Mousse . I guess I was thinking too Canadian...

      These have not been my best days (posts).

        I meant Search::Mousse

        Then you're still out of luck I'm afraid. S::M uses CDB_File; and that uses cdb which is limited to 4GB datasets.


        Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
        "Science is about questioning the status quo. Questioning authority".
        In the absence of evidence, opinion is indistinguishable from prejudice.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://860661]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others goofing around in the Monastery: (4)
As of 2024-03-28 18:28 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found