P is for Practical | |
PerlMonks |
Re: What DB style to use with search engineby BrowserUk (Patriarch) |
on Nov 10, 2009 at 22:45 UTC ( [id://806351]=note: print w/replies, xml ) | Need Help?? |
There is a good reaason why search engines don't allow full regex searches--they are simply too slow. You'd be better only allowing keyword searches. But, if you decide to try the big file route, a couple of things that will help are:
If you can limit a first pass to keywords only, then building an inverted index would be the fastest way of trimming the dataset. You could then allow a full regex search to be run on the subset of documents. Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.
In Section
Seekers of Perl Wisdom
|
|