The dude took slaves, instituted a brutal gold quota, hung the corpses of resistors to rot, and other cartoonishly evil things. He was such a piece of work even by Spanish colonial standards that he was hauled back to Spain and stripped of his governorship.
He was very, very far from a nice person.