Well since you cannot log in on your dedicated server, the best solution would be to reboot, yes.
There should be an option for your dedicated server, either in the server itself, or in the control panel, to automatically reject ping requests.
If not i suggest you contact your dedicated server-provider and ask them if they can offer any option to rejecting ping requests to your server.