in reply to Re: Download only part of a file from the web in thread Download only part of a file from the web
Any update? Or does anyone know of any tool that allows restricting the download size?
I am also trying to write a tool to automate analysis of flv files on the web. The clip analysis can be done with a header preview, so I want similar functionality to avoid full download.
Best regards,
-Avid (seeker of perl wisdom)
Re^3: Download only part of a file from the web
by tilly (Archbishop) on Dec 30, 2008 at 21:31 UTC
|
LWP::UserAgent has a max_size method that can limit the size that will be retrieved to a fixed number of bytes.
Or you can be more ambitious and pass a :content_cb callback to the get method. This will give you the response in chunks and you can then accumulate them in a variable. When your analysis says that you have enough you can die to end the request, and catch that at a higher level with an eval. This will be a lot more complex, but avoids having to guess how much of the file to download. | [reply] |
|