Yes there is a cost, it will use more memory and cpu cycles.
but potentially less cpu cycles if all plugins are running 64Bit float so no converting To and from 32bit float has to be done.
But we are talking 3-5%, well that is my experience, not a massive difference.