Beefy Boxes and Bandwidth Generously Provided by pair Networks
Syntactic Confectionery Delight
 
PerlMonks  

Re^6: Download big file in chunks with plack response

by kikuchiyo (Friar)
on Apr 24, 2021 at 14:03 UTC ( #11131686=note: print w/replies, xml ) Need Help??


in reply to Re^5: Download big file in chunks with plack response
in thread Download big file in chunks with plack response

I can't reproduce.

I've created a 2 GB file with dd, hardcoded its name in my script in Re: Download big file in chunks with plack response, executed ulimit -v 1000000 to limit available memory, then in the same shell ran the server as plackup script.pl. From a different terminal I've then ran curl http://localhost:5000 -o /tmp/thing.

Predictably, the server died with "Out of memory". Then, I've commented out the slurp line, as I've suggested earlier. Predictably, the server proceeded to serve the file and didn't die.

What are you actually doing, and what is your exact error message?

(I had to add a line \&return_psgi; for it to work with plackup, and I hardcoded the file name because I'm not aware of a way for a PSGI a handler to get a file name as an argument, so I suspect there is something else in the picture that you're not telling us.)

Replies are listed 'Best First'.
Re^7: Download big file in chunks with plack response
by Thenothing (Acolyte) on Apr 26, 2021 at 09:33 UTC
    Hello there kikuchiyo
    A big thank you for you testing, now the code is working

    The problem was, I was using plackup -L Shotgun to run the psgi app, and the error I was getting was.

    Magic number checking on storable string failed at /usr/lib/x86_64-linux-gnu/perl/5.22/Storable.pm line 420, at /usr/local/share/perl/5.22.1/Plack/Loader/Shotgun.pm line 35. Sometimes I get the error memory

    But when I change to just plackup, everything works
    here is the final code:

    use strict; use warnings; ####use Plack::Response; # doesn't seem to support streaming response use Path::Tiny; use File::MimeInfo; my $app = sub { my $env = shift; my $path_file = 'win.iso'; my $content_type = mimetype($path_file); $content_type = 'application/octet-stream' if not defined $content +_type; require File::Spec::Unix; my $basename = $path_file; $basename =~ s|\\|/|g; $basename = ( File::Spec::Unix->splitpath($basename) )[2]; $basename =~ s|[^\w\.-]+|_|g; return sub { my $responder = shift; my $writer = $responder->( [ 200, [ 'Content-Type' => $content_type, 'Content-Disposition' => qq[attachment; filename="$ +basename"], ] ] ); open (FILE, "< $path_file") or die "can't open $path_file: $!" +; binmode FILE; local $/ = \102400; while (<FILE>) { $writer->write($_); } $writer->close(); close FILE; } }
    again thank you so much for your time and your code

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://11131686]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others pondering the Monastery: (4)
As of 2022-08-10 17:13 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found

    Notices?