Depends on what version of USB you're using. 1.1 transfer rates are slower than most hard drives, 2 or above are about the same.

and agreed on the keeping your own OS around. I used to do that with freeware windows stuff, when I was hopping from machine to machine a lot... linux would just be safer over all if you're using public machines, or dealing with a possibly infected machine.