http://qs321.pair.com?node_id=11139479

We had an intermittent outage, but now the site is back up.

The outage was caused by an upgrade to the MySQL client libraries, which made them not want to talk to the server anymore. The error code was ERROR 2027 (HY000): Malformed packet. The solution is described on StackOverflow.

The resolution was to upgrade the DB password on the server to a new algorithm, which was a fix done in three minutes.

The hard parts were getting home, looking through all the logs, and finding the error :)

Replies are listed 'Best First'.
Re: Site outage
by jdporter (Chancellor) on Dec 09, 2021 at 01:40 UTC

    Please don't ever leave! I can't do what you do!

    I reckon we are the only monastery ever to have a dungeon staffed with 16,000 zombies.
[reply]
Re: Site outage
by stevieb (Canon) on Dec 08, 2021 at 22:13 UTC

    Good work, and thanks to your prompt attention to the matter and the speedy resolution!

[reply]
Re: Site outage
by GotToBTru (Prior) on Dec 10, 2021 at 19:56 UTC
    The outage was caused by an upgrade ...

    Reminds me of the pilot's adage that at no time is a plane more likely to be unsafe than just after it's been fixed.

    But God demonstrates His own love toward us, in that while we were yet sinners, Christ died for us. Romans 5:8 (NASB)
[reply]
Re: Site outage
by LanX (Saint) on Dec 09, 2021 at 11:46 UTC
    > which made them not want to talk to the server anymore.

    curiously this was not continuously so.

    It was sometimes possible to interact, I even posted during the "outage", tho it took me dozens of attempts.

    Thanks for fixing, anyway! :)

    Cheers Rolf
    (addicted to the Perl Programming Language :)
    Wikisyntax for the Monastery

[reply]
      Maybe only some of the servers were misbehaving?

      map{substr$_->[0],$_->[1]||0,1}[\*||{},3],[[]],[ref qr-1,-,-1],[{}],[sub{}^*ARGV,3]
[reply]
[d/l]

Back to Perl Monks Discussion