Re^2: Some Weird behavior with BerkeleyDB and WWW::Mechanize

there really isnt much else to my code:

#!/usr/bin/perl -w
use strict;
use BerkeleyDB;
use WWW::Mechanize;
my $mech = WWW::Mechanize->new();

my %pageHash;

tie %pageHash,  "BerkeleyDB::Btree",
                -Filename => 'pageContents',
                -Flags    => DB_CREATE,

        or die "Cannot open file pageContents: $! $BerkeleyDB::Error\n
+" ;

my %hash;


tie %hash,  "BerkeleyDB::Btree",
                -Filename => 'videoDB',
                -Flags    => DB_CREATE,

        or die "Cannot open file videoDB: $! $BerkeleyDB::Error\n" ;

foreach my $x (keys %hash)
  {
    print "getting $x:";
    my $data = $hash{$x};

    my @parts = split(/\t/, $data);

    my $url = $parts[0];
    $mech->get( "$url" );
    if($mech->success())
      {
        #$pageHash{$x} = $mech->content( format => 'text' );
        print " done\n";
      }
    else
      {
        print " failed\n";
      }
    sleep(15);
  }
[download]

Comment on Re^2: Some Weird behavior with BerkeleyDB and WWW::Mechanize Download Code

Replies are listed 'Best First'.
Re^3: Some Weird behavior with BerkeleyDB and WWW::Mechanize by moritz (Cardinal) on Dec 05, 2007 at 20:50 UTC
I tested your code (I added two URLs to the hash) and I can't reproduce your problem. Neither key nor value get modified in any strange ways. Maybe try to move your pageContents files and start with an empty, clean one and check if the error still occurs.	[reply]
Re^4: Some Weird behavior with BerkeleyDB and WWW::Mechanize by downer (Monk) on Dec 05, 2007 at 20:53 UTC
i get the following error : `Use of uninitialized value in pattern match (m//) at /usr/lib/perl5/vendor_perl/5.8.6/HTTP/Cookies.pm line 45.` each time through the loop. I think this is happening somewhere within the WWW::Mechanize->get(), maybe this regex is modifying the regex somehow?	[reply] [d/l]
Re^5: Some Weird behavior with BerkeleyDB and WWW::Mechanize by moritz (Cardinal) on Dec 05, 2007 at 21:34 UTC
I seriously doubt that. If you look at `sub get` in Mechanize.pm: `sub get { my $self = shift; my $uri = shift; ...` [download] The parameter `$uri` is passed by value, which means it is copied. Even it is modified later on, you'll never see that in your script because it's just a copy that's modified. However the `uninitialized value` might be a hint. Check `$url` for definedness, and die if it's not, then rerun your script.	[reply] [d/l] [select]
Re^6: Some Weird behavior with BerkeleyDB and WWW::Mechanize by downer (Monk) on Dec 06, 2007 at 00:17 UTC
Re^7: Some Weird behavior with BerkeleyDB and WWW::Mechanize by Anonymous Monk on Dec 06, 2007 at 07:49 UTC


Don't ask to ask, just ask
	PerlMonks