I don't wash the soap after usage unless, it's going out on a sale/trade. Then I wash it well and pat it completely dry before sending.
Try wash my soap once though it in the dishwasher after I was done wth it fun thing after the dishwasher was done my soap was gone but man my dishes looked and smelled good and the glasses were spot free ummm might be on to something here.