Re: File Processing...


Clear questions and runnable code get the best and fastest answer
	PerlMonks

Re: File Processing...

by ayrnieu (Beadle)

on Mar 20, 2006 at 00:08 UTC ( [id://537837]=note: print w/replies, xml )

Need Help??

in reply to File Processing...

use Tie::File; I have seen it quite capable of dealing with very large files given very little wiggle room.

Oh, wait, 200MBs? Nevermind.

It doesn't seem that you need exactly 200MBs, as you want to know how to conditionally go over 200MBs; also, you are dealing with text files... is it possible that you actually want to split the file by your 'certain string'?

Comment on Re: File Processing... Download Code

Replies are listed 'Best First'.

Re^2: File Processing...
by Anonymous Monk on Mar 20, 2006 at 01:55 UTC

I asked them this too, if I could just split the file by strings...that'd be easy....

Since I don't know what the data is for or from(they don't tell me, since I am not a permanent employee) they just said that these strings are too frequent among the file. They're something like START_HTML and END_HMTL is what I've heard. Maybe its a web crawler?

But they said that splitting based on this would make thousands and thousands of files. So I can't.

[reply]

In Section Seekers of Perl Wisdom