John Quincy Adams

The most intellectually gifted president who was also one of the least politically talented — Adams lost to Jackson after the 'Corrupt Bargain' gave him the presidency, then spent 17 years in the House after leaving office fighting slavery, becoming the only ex-president to serve in Congress.