This is a known and documented issue. Cubase 10, Nuendo 10 and I believe all Steinberg plugins on Windows only support integer (whole number) scaling in HiDPI mode.
Hopefully full HiDPI support for Windows will come along soon. Your best option for now is likely to turn off HiDPI mode in Cubase and Nuendo.