then fp32 precision is not enough?

FP precision is allocated unevenly through the range. If separate numerators and denominators are accumulated during operation, would it be useful to do regular cancellations?

how do we due with this situation then?