Exactly, u just gotta use your best judgement and decide if its a throwaway sample or not.
I usually never use a sample if its just too beat and battered.
If its just "light static" then I let it ride and maybe eq some of it out later in the DAW.
If its severe pops but only in a couple spots...