Small buffers during tracking, large during mixing?

The reason for me raising buffers (and I’m sure this is per usual) is that when my song projects got busy, I started experiencing crackles, pops, various tracks drifting in & out of time with each other, and then crashes. Mind you I’m talking about overloading a Win XP 32 bit 4/GB ram machine. A necessary low latency for tracking say, guitars with Amplitube soft amp sim could only be used at the earliest stages, which didn’t always work that way. That’s why I gravitated toward hardware amp sims, to ease unnecessary loads…which reducing/eliminating loads became my main theme.