http://qs321.pair.com?node_id=1169325


in reply to WWW::Mechanize::GZip and post() Issue

Most of the times it's some HTTP Header missing: Content-Type, X-Requested-With or Referer. Just find what headers were send by your webbrowser and repeat same headers in your code.

Replies are listed 'Best First'.
Re^2: WWW::Mechanize::GZip and post() Issue
by rotneyjacob (Initiate) on Aug 08, 2016 at 21:14 UTC

    As you said i tried replacing WWW::Mechanize::GZip as WWW::Mechanize but it gave me a result like this.

    `I%&/m{JJt`$ؐ@iG#)*eVe]f@흼{{;N'?\f
+dlJɞ!?~|?"ǿ|<oo<
                                                                      
+                                ?ۢ-Ӻw,ozQ›kN›棴>
+j2oy~ޝfol9V‹n{go:ou=QVӯw]Ƥ]笸L
+‹gU6+2#jcnZfMC_Ib9+Y[2Q:/f|)bq6
+‹EvAx/Ҭl?H&*[n/‹c}ZU(v9Lϫe?ȥwCI›
+iѤPꢼN2+lRǓ}YYU:ɦol9K:.b9?‹.~q?
   ?-

    [download]

    This is the what i received in Live HTTP Header. Can you please edit my code accordingly

    http://domain.com/affiliates/Extjs.ashx?s=subaffsummary

POST /affiliates/Extjs.ashx?s=subaffsummary HTTP/1.1
Host: domain.com
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:47.0) Gecko/2010010
+1 Firefox/47.0
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.
+8
Accept-Language: en-US,en;q=0.5
Accept-Encoding: gzip, deflate
X-Requested-With: XMLHttpRequest
Content-Type: application/x-www-form-urlencoded; charset=UTF-8
Referer: http://domain.com/affiliates/
Content-Length: 217
Cookie: .lat=1470690366019; .auth8=85946C2BF28A9B5023E9740FE20651D6CBF
+ECE8C58B5FF6FDA19AA91CD5A4467FE99666B4CB729B552CA95F52A34748E7922F22C
+A125024B788B49BF3E1C3170ADFEBE7D7B3512504E93ABDC3ADEEFF8EB279A1EA1EF9
+2D7F96C485D6C0037EAFB98E916F340A5ECF9DF1617B6B92DB109FC18B7A97D314344
+6D40E7443255C06C3A0CEFA0FE6448840B8E638C24512A1EAEE2CF43DD7106A05A75A
+1F6BA6A0A1526A9E5E7C097804AB5D9C381EAB78FFB188CB954C92E1AE16DE120C83E
+F4B0BC790AE0A86EC1F243C995A48DCA9901D41928C445E14EDBFEAFDCB7CFA1B4ADF
+665BFD89ECB97911F9E498193A750AF
Connection: keep-alive
groupBy=&groupDir=ASC&o=sub_id&d=DESC&report_view_id=145&report_id=95&
+report_views=Default&exclude_bot_traffic=0&date_range=today&start_dat
+e=8%2F09%2F2016&end_date=8%2F09%2F2016&n=30&enter_subaffiliate_id=&ti
+mezone=ET
HTTP/1.1 200 OK
Cache-Control: private
Content-Type: application/json; charset=utf-8
Server: Microsoft-IIS/7.5
X-AspNet-Version: 4.0.30319
x-powered-by: ASP.NET
Date: Mon, 08 Aug 2016 21:06:29 GMT
Content-Length: 333

    [download]
[reply]
[d/l]
[select]

      What headers does your script send?

      Have you looked at the documentation, which I previously linked already? I'll link it again, for your convenience, here. Maybe this time you not only click it but copy the code shown there and put it to work in your program?

[reply]

      Could the result you got back from the server you pasted in your first paragraph be the gzipped document you asked to download?

      That server response looks much better that the "system unavailable" you got before trying Corion's suggestion.

      Also use these setup in order to eliminate issues of rejection due to bad UAgent String and cookies turned off:

      1) Use appropriate "user agent string" e.g. 
      my $mech = WWW::Mechanize->new( agent => 'Mozilla/5.0 (Windows NT 6.1;
+ WOW64; rv:47.0) Gecko/2010010
+1 Firefox/47.0' );

      [download]
      2) Use a cookie jar in order to save all the cookies for entire session leading to the file download, 
      my $mech = WWW::Mechanize->new( cookie_jar => {} );

      [download]
[reply]
[d/l]
[select]
[reply]

In Section Seekers of Perl Wisdom