http://qs321.pair.com?node_id=149808

basicdez has asked for the wisdom of the Perl Monks concerning the following question:

Hello Monks

Do any of you know if when using perl to write data into an xml format using xml::writer if there would be any reason that I would encounter a limit? I am currently creating xml files with close to 400,000 MB on a Unix environment and it appears as though the writer is preventing itself from writing out the last lines of the xml file. This is causing problems with reading in of the xml file by another program as there are no ending tags. Any help with this would be appreciate.

peace, LOVE and ((code))

basicdez

Replies are listed 'Best First'.
Re: Any limits with XML::Writer?
by Matts (Deacon) on Mar 07, 2002 at 07:57 UTC
    You're writing 400 GIGABYTE XML files??? What on earth is going in those files (and what OS are you using that supports files that size)? There are some things XML just shouldn't be used for, and I think you may have found one!
Re: Any limits with XML::Writer?
by steves (Curate) on Mar 06, 2002 at 20:46 UTC

    Well, you're past my personal high water mark. I have a lot of daily XML files that are ~50 meg. that I generate with XML::Writer. I've never experienced the problem you describe.

    Could it be an output buffering/flushing issue? Is the reader reading the generated XML while the writer is still running? If so it may just be a matter of closing the output file or setting writes to be unbuffered.

    My next guess would be that you've hit an OS file size limit. But 400 meg. seems too low for that.