Thanks to both of you for your responses. Great points and now it all makes a lot more sense.
I found a video tutorial series (kind of summary but still rather helpful) on Halion which featured using foley to make samples, and pretty much what I got out of it was a sampler would be great to have, and I am going to need one, but specifically for my purpose as described I really am just going to have to create a library and make media bay work. Everything I make is for my own personal use anyway, at this point at least.