Generally changing the password would stop a normal hacking a site.
But it seems the admin interface (CMS) is the problem. Have you tried a FTP program to upload to your site?