You don’t have to run at really low latencies if your computer cant handle it.
FWIW, I record at 88.2 and during tracking, I am at 1.5 ms latency with direct monitoring off. If a computer isn’t up to that task, Direct monitoring goes on. Or: you start the mix production, insert plugins and have to raise the buffers then decide to do overdubs and need realtime, direct monitoring gets turned on.
It is a different flow without a desk. I’m not sure where you are, but if you are in the area, you are welcomed to visit to get an idea of what it is like using a rig like mine. I love it and I built it a few channels at a time. And I am serious when I said, not having an EQ on every channel forced me to learn microphone placement better, using the placement and different microphones to do the eq for me.