it seems like you want to restrict yourself to 2 digits after the point. Hence instead of print,you use "printf or sprintf" functions in the type of notation you want, in this case the "f" for floating numbers preceded by the digit capacity, that is 3 digits before the point and two digits after the point, preceded by %, so it would look like this printf "%6.2f", notice, the point is included in the count hence 6.2 instead of 5.2(Updated after Albannach reply)

$count = 895.3;
while ($count <= 899.99) {
    $count += 0.01;
    printf "%6.2f",$count; #(updated)
    print "\n";
}
[download]

the numbers in computers are approximations and hence comes such issues esp while using higher level programming languages such as Perl.