U can us reverse ARP lookup, this enables you to convert the MAC to an IP,

The problem with this is that if someone is coming and go to and from your wireless ap, the likely hood of there IP changing is high. But there MAC address is highly unlikely to change.

It would probably be more hassle free if you just secure you network against these attacks and learn something from them instead of trying to take revenge, Its up to you though..and im not saying its good or bad (I couldnt care less). But thats probably what Id do.

i2c