apparently Andrew Jackson was nicknamed Jackass, and ended up using the symbol spitefully on his campaign materials, and then cartoonists started using it as a shorthand for his party