Abraham Lincoln was the tallest U.S. President at 6'4", while James Madison was the shortest at 5'4".