Well it seems to have started working all of sudden, the only think I done apart from trying from other clients.

Maybe the cleanfreebusy switch worked. I don't know.

Should have tried the OWA part.

The permission shouldn't have changed though, I tried it directly from the resource rather then the delegate and the resource also had the issue.

Thanks for information though