The biggest concern I would have is taking that input and being able to accurately normalize it. I can't see your files, but if you could normalize the data into proper table structures, you have a hope in using some sort of software available at your fingertips (maybe even Excel).

Sure you might not be able to do all your querying at once, but you could build your own MapReduce-like function from your tables.

---

Demize