Definitions of ivory nut:

• noun:   nutlike seed of a South American palm; the hard white shell takes a high polish and is used for e.g. buttons