Funny, they usually pay me to come up with solutions to this. TMTOWTDI. It's generally better to generate the flat files as they are created rather than having a secondary process crawl your site and generate them.