What type of "dress shoe"???? Are we talking a pair of Manolo's or some payless granny flats?
Also, it depends on your industry. In some fields, they're happy you showered, in others, the wrong choice may mean they pick someone else over you. It may seem silly, but I've been interviewed and gotten great comments about my Kate Spade bag. Since you often don't know the character of the person you'll be dealing with, better to err on the side of caution [ie my fun plaid bag didn't come to work until I passed the probationary period
].
Best of luck!