Binary is the number system used internally by computers, binary has two digits, one and zero, allowing computers to store values by setting digits to be either on (1) or off (0). Subject of the joke “There are 10 kinds of programmers in this world: those who understand binary, and those that don't”.
Binary can also refer to the machine code (I.E. an *.exe) application.