There are a lot of natural supplements that can help you. Cut on dairy products. Consume cranberry juice, raddish leaf juice and coconut water everyday. It will flush out the bacteria. Take a lot of vegetables and fruits. Drink a lot of clean water.
For immediate pain relief, try castor oil packs. Sit in a bathtub filled with warm water since it can ease the pain. Hope it helps.