Jersey Joe Walcott, Referee