Calxa Online is Unavailable

Resolved
Resolved
After 5 hours and 35 minutes

We're now closing this incident. Monitoring since the last database restore shows no ongoing errors.

Avatar for
{:closed=>"Closed", :complete=>"Complete", :false_alarm=>"False Alarm", :identified=>"Identified", :investigating=>"Investigating", :open=>"Open", :recovering=>"Recovering", :resolved=>"Resolved", :scheduled=>"Scheduled", :underway=>"Underway"}
After 4 hours and 57 minutes

We've restored databases again and tested all functionality. Calxa Online is operational again.

We'll continue to monitor our error logs to ensure there are no further issues before closing the incident.

Avatar for
{:closed=>"Closed", :complete=>"Complete", :false_alarm=>"False Alarm", :identified=>"Identified", :investigating=>"Investigating", :open=>"Open", :recovering=>"Recovering", :resolved=>"Resolved", :scheduled=>"Scheduled", :underway=>"Underway"}
After 3 hours and 15 minutes

We're finding issues with corrupted database data so we decided to stop the application to avoid further corruption until we understand the cause.

Avatar for
Recovering
After 2 hours and 45 minutes

Reports are now generating successfully however an issue still remains for organisation syncs.

Avatar for
Identified
After 2 hours and 24 minutes

Unfortunately since the restore we are now seeing issues with report generation and organisation syncing. We're current investigating.

Avatar for
Resolved
After 1 hour and 39 minutes

The database restore is now complete and Calxa is back to normal operation.

Avatar for
Identified
After 49 minutes

We've identified that we'll need to restore database backups to resolve this issue and it may take up to 2 hours for the restoration to complete. We'll keep you posted as we monitor the progress of the restore.

Avatar for
Investigating

We're investigating an issue with database connections and the web app is currently unavailable as a result.

Avatar for
Began at:

Affected components
  • Calxa Online Web App