http://qs321.pair.com?node_id=739290


in reply to performance issues

Think some more about this file.

Is the file only rarely changed? Or, is it changed much more rarely than it is searched? Or, at least, are the changes, when they come, relatively small?

If so, you could benefit enormously by importing the file into a database once, and then letting the database do the heavy lifting of indexing and searching.

Replies are listed 'Best First'.
Re^2: performance issues
by perlcat (Novice) on Jan 27, 2009 at 19:02 UTC
    Well the data is rarely changed - it is generated once every month. I will think about the database solution.