Cute As A Button by Gary Hainsworth

Where does the expression: cute as a button come from? I've never found buttons to be that adorable or some such synonym by any measure. Maybe during some time immemorial they used to be the way sliced bread was once an impossible fantasy.