fork doesn't really have anything to do with it. It's about threading. Keep in mind that fork creates a new *thread* in Windows, not a new *process*. The problem can be triggered more directly using:

perl -MMath::Pari -Mthreads -e "threads->create(sub{})->join();"
[download]

It appears that Math::Pari is not thread-safe.