don't some network devices use ICMP to keep track of host topology & stuff. once you kill ICMP, you create silence. if a host is removed or malfunctioning, there is no way to tell anymore.
ICMP's should be blocked by the firewall between your network and the internet. You will still have them within the network, but it can be very good to have the outside world hear silence when they try calling out to you