I don't know what is going on here, but I can spot three things that might shed light on the issue.

1. You have two versions of Term::Readline::Perl installed. I'm not saying I cannot see reasons why that could be, but you might want to elaborate on how it came about.
2. About 20% of tests for Term::Readline::Perl failed and there a number of bugs. I would also say "have you read the docs", but there does not seem to be any.
3. Searching for "SetConsoleMode" through the various modules mentioned threw up this interesting snippet in Term::ReadLine

    # the Windows CONIN$ needs GENERIC_WRITE mode to allow
    # a SetConsoleMode() if we end up using Term::ReadKey
    open FIN, (  $^O eq 'MSWin32' && $console eq 'CONIN$' ) ? "+<$cons
+ole" :
                                                              "<$conso
+le";
    open FOUT,">$consoleOUT";

    #OUT->autoflush(1);        # Conflicts with debugger?
    my $sel = select(FOUT);
    $| = 1;                # for DB::OUT
    select($sel);
    $ret = bless [\*FIN, \*FOUT];
  } else {            # Filehandles supplied
    $FIN = $_[2]; $FOUT = $_[3];
    #OUT->autoflush(1);        # Conflicts with debugger?
    my $sel = select($FOUT);
    $| = 1;                # for DB::OUT
    select($sel);
    $ret = bless [$FIN, $FOUT];
  }
[download]

Have you tried posting a small piece of code that reproducibly causes the problem?

Comment on Re: Problem Running Perl Debugger Download Code