Well you see, just above binary is assembly. But each assembly instruction is a binary word.
So if you wanted to code in binary, yes you could. You'd need a reference book for you processor's instruction set (cuz NO ONE knows those by hart!) and it would be very much like writing assembly only you write it directly in binary...

Ammo