Resolved

Thank you for your patience whilst we worked to resolve the system and API issues which we recently experienced.

We can now confirm that the changes we have made have fully resolved the system issues and we will continue to closely monitor the system performance.

Thank you.

Thank you for your continued patience during today’s system issues and we sincerely apologise for any inconvenience caused.

The People API is now back up and running as expected.

Following today’s investigation, our engineers have installed tracking code into our API in order to help identify any potential issues and prevent this from occurring again. We will continue to monitor this carefully until we are satisfied the issue has fully been alleviated.

In addition to this, we have become aware of an issue with the API rate limit when applied to the Query end point. The rate limit is effectively allowing developers to instantiate multiple query sessions, one after the other causing overall system performance issues.

Early this week we will apply the rate limit strictly to the query so that each query must complete before it's called again, attempting to call the query more than once will return an error 5 with an explanation.

As a temporary measure we have had to implement a change on Friday to the API - at the moment the result will return the following data packet

{ "isError": false, "Status": 0, "Message": "The requested processed successfully.", "Result": [ { "Message": "Please try after some time, query execution is already in progress" } ]}

Which is an error 0 but the message body contains the text indicating the previous query has not yet stopped executing.

Please note this change was made after careful consideration to protect the overall integrity of the People system.

Following the above change, if you have any custom integrations which utilise the API, the developer of the program may need to make amendments to the code in order for your program to handle the above code. This does not affect the defaults integrations handled by People HR.

If you need any further information, please ask your developer to email customerservices@peoplehr.com

Thank you.

We are sorry for the issues experienced this morning.

The system is now responding and you will be able to login.

Our API will continue to be degraded until further notice. Our engineers are closely monitoring the situation and will post an update here shortly.

Thank you for your patience whilst we perform essential maintenance in order to identify and resolve this mornings issues.

The system will continue to be inaccessible until approximately 11:30am BST. Our engineers are continuing to work on resolving the issue and we will ensure this is completed as quickly as possible to minimise downtime.

We will ensure you are updated on the status here.

Thank you for your patience whilst we continue investigating the root cause of this mornings issues.

We have some performance issues which is affecting many customers. Our engineers have identified a potential issue which may be causing this.

At 10:15am BST today, the system will temporarily be inaccessible for approximately 30 minutes whilst we perform essential maintenance.

We sincerely apologise for the inconvenience caused and will ensure that you are kept up to date here.

We are very sorry for the continuing issues. Our teams are investigating the issues and working on a resolution. We will post regular updates here.

We are very sorry for the continuing issues. Our teams are investigating the issues and working on a resolution. Our API module is currently degraded and we will update the status here regularly.

Ongoing

Some of our People users are experiencing issues loading the system at present, our engineers are working to have this resolved, we will post regular updates here to keep you informed. We apologise for any inconvenience.

Began at: