are you sure that you seated the battery on its proper manner?

Try to reinstall the battery on its place...
It seems that you repalce it but you didnt check if the battery is fix on its place, it shouldnt be shaking.
It might be the battery is not inserted properly... try to see again...