Is it safe to keep pressing the starter button on an electric hot water heater start it?

There is no 'starter button' on electric hot water heaters. Electric water heaters are typically a set-and-forget appliance. Once installed and turned on, the water heater will automatically maintain the set temperature.