Actually, that 32 bit is still 24bits of mantissa and 8bits of exponent.
However, if 0dB has been exceeded at any time up till output, those ‘overload’ samples will have lower bits that actually match the not so low bits of the other samples, due to the increase in the exponent shifting them all up, so dithering is still recommended.