We didn’t have any issues of this kind anymore. It is sample accurate regardless of buffer settings.
Make sure to have “Rehearsal” deactivated.
Try to deactivate ASIO Guard (Devices/Device Setup/VST Audio System).
If that doesn’t help, we need more details.