Look at anyone who just enjoys computers and leaves it at that... this as opposed to anyone who uses the H-word either in the so called "ethical" sense or not you'll notice the difference between the two right way. A "hacker" is someone who has...

A: Turned on their computer in the hopes and dreams of "being something" and/or "being known for something".

B: Set themselves apart from any random Joe on the internet by appointing themselves and people around them "hackers" and maybe even other various words of self importance despite how limited they actually are as far as computers go.

Oh and my favorite at the moment C: Gets defensive and angry when you sum it up in a way they feel some how hurts their image.