I'm looking for a good crawler...

I've used MS visio in the past for diagrams, wget for grabbing the actual files... I'm looking for something that can handle logins and such... that will stop and ask me to fill in forms and whatnot.

I've given the burp suite and webscarab both shots, I wasn't impressed by either.

Any recommendations?