Call your dentist or doctor as soon as possible and explain your situation, I'm pretty sure that you need an antibiotic to clear up the infection.
I am not a doctor, but I think it is possible that bacteria from tooth infections could spread throughout the body and cause things like kidney infections.