Definitions of information theory:

• noun:   (computer science) a statistical theory dealing with the limits and efficiency of information processing