Beefy Boxes and Bandwidth Generously Provided by pair Networks
Your skill will accomplish
what the force of many cannot
 
PerlMonks  

Log On To Secure Site

by Kass (Initiate)
on May 26, 2017 at 15:41 UTC ( [id://1191304]=perlquestion: print w/replies, xml ) Need Help??

Kass has asked for the wisdom of the Perl Monks concerning the following question:

I would like to be able to log on to secure sites such as the Dallas Library and Optionsxpress programmatically in order scrape them. I've tried using Curl, but always get stuck. Help would be greatly appreciated. Jerry Kassebaum

Replies are listed 'Best First'.
Re: Log On To Secure Site
by shmem (Chancellor) on May 26, 2017 at 21:04 UTC

    Have a look at WWW::Mechanize, it could very well address your requirements.

    perl -le'print map{pack c,($-++?1:13)+ord}split//,ESEL'
Re: Log On To Secure Site
by stevieb (Canon) on May 26, 2017 at 15:48 UTC

    Please show us the Perl code that you've tried and are having issues with.

    This isn't a free code-writing service.

      Or at least the tests you made with curl to illustrate how you got stuck.

      If you need something ready to use, you can try CPAN or even ask to those websites how to properly authenticate against them.

      Alceu Rodrigues de Freitas Junior
      ---------------------------------
      "You have enemies? Good. That means you've stood up for something, sometime in your life." - Sir Winston Churchill
Re: Log On To Secure Site
by marinersk (Priest) on May 26, 2017 at 17:26 UTC

    If you're looking for some Perl module suggestions, I'd search Perlmonks and CPAN for things related to HTTP and LWP, perhaps augmenting the search with the word "secure".

Re: Log On To Secure Site
by planetscape (Chancellor) on May 29, 2017 at 08:50 UTC

    Do those sites' Terms of Service permit this activity?

    HTH,

    planetscape

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: perlquestion [id://1191304]
Approved by Marshall
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others taking refuge in the Monastery: (2)
As of 2024-04-16 23:11 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found