Well what OS are you running. Because you can run Nessus from your linux box. It checks for lots of vulnerabilities and will probably let you know if your server has any vulnerabilities. But yes as long as your just regular connecting to it then it is considered remote access. But you can run the vulnerability scanners from your own computer and they should be able to find them.