I've never been effected by poison ivy and I'm 95% sure that I've encountered it before. The way you put it sounds right, that a toxin affects everyone and allergens don't, but are you sure that urushiol considered a toxin?
That seems like a strong possibility. At least where the dishes are touching the rack.