Can you get pregnant like this?

know this may seem silly, but I didn't want to have sex because I had just gotten off of antibiotics, but I gave him a ********. I think I wiped my hands, but I'm not sure. Then, I touched myself, but I had a tampon in. If my hand had any sperm on it, was this unsafe as far as pregnancy is concerned? I am on the pill, but it may have been inactive because I had recently gotten off antibiotics and the pharmacist said I needed a full month of the pill for it to work again.