Hi xphen0m,
I Have a Scarlett 2i4 which is working incredibly well with my really cheap old i5 computer. Are you using the 3.2.2 driver because it’s great? http://beta.focusrite.com/
When recording my midi parts via my keyboard I set my buffer size to 128 samples which gives me an input/output latency of 9.146 ms which is Ok for recording and when I’ve finished recording all the parts I reset the buffer size to 2048 samples for playing back and mixing and mastering and everything works like a dream!
Hope this helps?
Kind regards
James Colah