They can set your SMTP server as their outgoing mailserver to send spam.