Have you tried configuring NTP server? That way, it will stay in sync with something.
When you power the router off, generally the clocks get out of sync relying on a crystal to keep time.
Services -> NTP . Enter an NTP server for your local and go from there.(These can be googled quite easily)