^^
Okay, I will accept both. I had always been told that Franklin Pierce was the only president not renominated by his party.
"By the end of his administration, Pierce could claim "a peaceful condition of things in Kansas." But, to his disappointment, the Democrats refused to renominate him, turning to the less controversial Buchanan. Pierce returned to New Hampshire, leaving his successor to face the rising fury of the sectional whirlwind. He died in 1869. "
http://www.whitehouse.gov/history/presidents/fp14.html
So we have 3 - Pierce, Arthur, and Fillmore.
Next?