How do I download a file that needs username and password?

Zork2 has asked for the wisdom of the Perl Monks concerning the following question:

I am trying to download some JSON files from URLs of the form:

https://stt.disruptorbeam.com/player?client_api=N

Where N is an integer, eg

https://stt.disruptorbeam.com/player?client_api=1

But i get sent to a login screen.

In a web browser this is fine, you just click the "Sign in with Dbid" link, then enter your username and password, after which the URLs will work.

However i have absolutely no idea how to do this in perl.

Any help would be appreciated.

Thanks

Comment on How do I download a file that needs username and password? Select or Download Code

Replies are listed 'Best First'.
Re: How do I download a file that needs username and password? by LanX (Saint) on Feb 21, 2021 at 13:54 UTC
Did you try `LWP` ? See also lwpcook for examples update ... and lwptut for introduction Cheers Rolf _{(addicted to the Perl Programming Language :) Wikisyntax for the Monastery}	[reply]
Re: How do I download a file that needs username and password? by 1nickt (Canon) on Feb 21, 2021 at 13:20 UTC
Hi, you could automate your login with WWW::Mechanize or one of its subclasses. Hope this helps! The way forward always starts with a minimal test.	[reply]
Re: How do I download a file that needs username and password? by Anonymous Monk on Feb 21, 2021 at 13:18 UTC
the secret is probably cookies, WWW:::Mechanize	[reply]
Re: How do I download a file that needs username and password? by Bod (Parson) on Feb 21, 2021 at 19:40 UTC
Like LanX, I would (probably) use LWP for this task depending on the complexity of the site's login system. You probably want to look at the documentation for enabling cookies.	[reply]
Re: How do I download a file that needs username and password? by Zork2 (Initiate) on Feb 22, 2021 at 15:43 UTC
Thanks everyone! I'll take another look at LWP, but WWW::Mechanize looks very promising.	[reply]


The stupid question is the question not asked
	PerlMonks