Benefit of recording 32-bit audio?

I read that 32 bit float reduces rounding errors caused by plugins and reduces noise from dithering? If you have enough storage, hard drives are cheap, then why not use 32 bit?