Depends. Older Windows machines would lock up when an IP address conflict was encountered. Now they just shrug it off. So most likely you won't hurt anything, just raise a few alarms.