Filter By Components

January 2017

No incidents reported for this month.

December 2016

ScrapyCloud Performance Issue.
Between 03:00 UTC and 03:45 UTC on December 1st 2016, Scrapy Cloud experienced problems with job scheduling, execution and deployment. This caused some degraded performance in Dashboard as well. The issue was due to some services using expired SSL certificates. The issue has been fully resolved.
Dec 1, 05:11 UTC

November 2016

Portia and Scrapinghub Dashboard unavailable
Portia and Scrapinghub Dashboard was unavailable for 30 minutes on 29th November 2016, between 12:40 UTC and 13:10 UTC. The issue was found to be because of an internal server issue. This has been resolved and the services are back to normal.
Nov 29, 12:52-13:43 UTC
api.crawlera.com was briefly down
api.crawlera.com was unavailable on November 25th 2016 between 3:28-3:38 UTC. This issue has been resolved
Nov 25, 15:42 UTC
api.crawlera.com was briefly down
api.crawlera.com was unavailable on November 10th 2016 between 17:08-17:15 UTC. This issue has been resolved.
Nov 10, 17:20 UTC
api.crawlera.com was briefly down
api.crawlera.com was unavailable on November 5th 2016 between 12:27-12:39 UTC. This issue has been resolved.
Nov 5, 12:43 UTC
api.crawlera.com is currently down
On November 3rd 2016, one of the API end points for Crawlera (api.crawlera.com) was unavailable between 14:29 and 14:35 UTC. The issue has been resolved by restarting the service. We are continuing the investigate the underlying cause to prevent future recurrence. This issue did not affect other API end points for Crawlera.
Nov 3, 14:33-14:38 UTC
api.crawlera.com was briefly down
api.crawlera.com was unavailable on November 2nd 2016 between approximately 10:10 and 10:30 UTC This issue has been resolved.
Nov 2, 11:22 UTC

October 2016

Crawlera temporary issue
Crawlera API was unreachable on 31st October 2016 between 15:36 and 15:56 UTC. Some Crawlera users were affected. The issue was solved by our team.
Oct 31, 21:37 UTC
Crawlera Performance Issue
The issue has been resolved.
Oct 27, 08:12-22:42 UTC
Scrapy Cloud performance issue
Services are back operation. We will continue to monitor the situation.
Oct 27, 18:42-18:48 UTC
Scrapy Cloud performance issue
The issue has been fully resolved.
Oct 22, 21:18-22:12 UTC
Chat Support is down
Chat support is back up now.
Oct 21, 13:20-13:52 UTC
Portia unavailable
On October 8th, 2016, Portia services were unavailable and experienced problems with job execution. The root cause was within a node of our database servers. This issue has been fully resolved by 16:30 UTC.
Oct 8, 10:21-16:40 UTC
Performance issue with Scrapy Cloud
Between 20:56 UTC and 23:30 UTC on October 7th, 2016, Scrapy Cloud experienced problems with job scheduling, execution and deployment. This may have caused some degraded performance in Dashboard as well. The root cause was within a node of our database servers. This issue has been fully resolved
Oct 7, 20:56 - Oct 8, 02:41 UTC
Crawlera services Impacted.
Crawlera services were impacted from 11.40 UTC to 12.26 UTC. There were some server issues which have been resolved and Crawlera services are up and working.
Oct 7, 12:03-12:31 UTC
Scrapinghub platform unavailable
Scrapinghub platform was unavailable on 4th October 2016 from 09:10 UTC till 10:30 UTC due to a networking issue. All services have been fully restored. We regret the extended downtime and we are taking steps to prevent recurrence for this type of issue.
Oct 4, 09:17-10:35 UTC

September 2016

Dashboard and deployment issues
On September 26, 2016, Scrapinghub Dashboard services were experiencing issues between 18:20 UTC and 20:40 UTC, due to network connectivity issues. This issue has been fully resolved. The issue was identified and rectified by 20:40 UTC and monitored after that until all operations were confirmed to be working fine by 20:50 UTC.
Sep 26, 20:01-21:14 UTC
Scrapy Cloud platform temporary unavailable
Between 5:45 and 10:15 UTC on September 23rd, 2016, Scrapy Cloud experienced intermittent problems with job scheduling, execution and deployment. This may have caused some timeouts in Dash as well. The root cause was a problem with one of the backend storage servers. This issue has been fully resolved.
Sep 23, 08:06-10:31 UTC
Crawlera overview history temporarily unavailable
Crawlera Recent Requests were unavailable from Scrapinghub Dashboard between 15:50 and 16:00 UTC on Sept 6th 2016 due to a back end failure. This has been fully resolved, this did not affect active jobs and no data was lost.
Sep 6, 15:51-16:47 UTC

August 2016

Scrapy Cloud Platform temporarily unavailable
On Aug 30th, 2016, at approximately 23:00 UTC, Scrapy Cloud experienced issues with job scheduling, execution and deploying. This may have affected your ability to run your jobs in the Dashboard. We have identified it as a network incident with our providers. First attempt to workaround it helped restore scheduler throughput at approximately 04:08 AM UTC. The final workaround that helped reduce jobs failing and deployments due to timeouts on docker pull, was at 06:22 AM UTC. All services are back to normal now.
Aug 31, 06:51-07:27 UTC
Scrapy Cloud Jobs Issue
Even though we are still waiting for a final confirmation from our network provider, our diagnosis show that issue has been resolved.
Aug 24, 18:34-21:46 UTC
Temporary slowdown in Scrapy Cloud.
This issue has been resolved as of 11:40 UTC.
Aug 23, 08:14-11:51 UTC

July 2016

Dashboard/API unavailable
On July 15, 2016, Scrapinghub Dashboard and API services were unavailable between 7:00 UTC and 9:00 UTC, due to network connectivity issues. This issue has been fully resolved. The issue was identified and rectified by 8:00 UTC and monitored after that until all operations were confirmed to be working fine by 9:00 UTC.
Jul 15, 08:02-09:27 UTC
Dashboard/API unavailable
On July 12, 2016, Scrapinghub Dashboard and API services were unavailable between 10:50 UTC and 12:23 UTC. This issue has been fully resolved. The recovery started at around 12:23 UTC and all services were fully operational by 13:30 UTC.
Jul 12, 11:49-15:03 UTC

June 2016

Dashboard/API availability issue
Between 19:35 - 20:00 UTC on June 29th 2016, we had some issues with our back-end storage that impacted the ability to access/control jobs through Scrapinghub Dashboard or API. This issue has been resolved.
Jun 29, 20:07-20:14 UTC
Google authentication is broken
The problem with Google auth has been resolved, sorry for the inconveniences!
Jun 27, 17:41-19:25 UTC

May 2016

Job Scheduling Issue
On May 31st 2016, at approximately 14:35 UTC, Scrapy Cloud experienced an issue with job scheduling. This may have affected your ability to see the jobs in the Dashboard. We have identified the root cause to be related to a long running query in the backend database that performs job scheduling. We resolved the problem around 16:10 UTC. Both current and scheduled jobs will now resume normally.
May 31, 16:05-16:26 UTC
Project deployment issues
The deployment issue has been resolved, and all services are up and running. We have increased the capacity to handle the load of deployments.
May 11, 17:43-23:11 UTC

April 2016

No incidents reported for this month.

March 2016

[Scheduled] Jobs database maintenance
The scheduled maintenance has been completed.
Mar 30, 15:39 UTC

February 2016

Performance issues with Scrapy Cloud
This incident has been resolved.
Feb 24, 11:55 - Feb 25, 12:28 UTC
Web dashboard is currently down
This incident has been resolved.
Feb 22, 16:47-20:18 UTC

January 2016

Jobs failing with 'no_reason' outcome
We have fixed a dependency problem related to add ons and jobs should now be running as normal.
Jan 18, 11:52-13:03 UTC
Jobs page and HubStorage API were having partial outage
From 2016-01-14 15:24 UTC to 2016-01-14 16:05 UTC, some customers had problems in viewing jobs page on dash or visiting hubstorage web api. This was due to a misconfiguration of the backend servers during the upgrade process. The problem has been fixed now.
Jan 14, 17:09 UTC

December 2015

[Scheduled] Main database maintenance
All systems are operational.
Dec 26, 13:30-15:29 UTC
Job Queue down for 15 minutes (from 16:25 UTC to 16:39 UTC)
This issue has been fixed
Dec 9, 17:33-18:26 UTC
Scrapy Cloud Periodic Jobs not scheduled
Today between 7:30 UTC and 9:15 UTC, Scrapy Cloud periodic jobs were not being scheduled. The root cause was identified in a platform release this morning. A fix was deployed soon after and periodic jobs are running normally again.
Dec 1, 10:18 UTC

November 2015

Jobs cancelled in Dash
Some jobs were inadvertently cancelled due to inactive jobs not being detected properly.
Nov 5, 15:07 UTC

October 2015

Scrapy Cloud jobs using Crawlera add-on fail to start
This incident has been resolved.
Oct 20, 14:18-14:38 UTC
Crawlera bug
Patch deployed. Crawlera is back operational.
Oct 5, 16:00 - Oct 6, 13:11 UTC
Web dashboard is currently down
Operations are back to normal. Outage was between 13:24 and 13:36.
Oct 5, 13:35-13:41 UTC

September 2015

Dash is currently offline
This incident has been resolved.
Sep 18, 04:00-04:36 UTC
Dash intermittent down time
We were experiencing a software problem on one of the instances of our cluster and that produced intermittent behaviour on dash. We've fixed the problem by recycling the task on a new host.
Aug 31, 21:58 - Sep 1, 03:27 UTC

August 2015

No incidents reported for this month.

July 2015

Web dashboard slowness
Web dashboard is back to normal. The problem was due to a malfunction on our service provider equipment.
Jul 1, 10:00-11:23 UTC

June 2015

Dash is currently offline
This incident has been resolved.
Jun 11, 14:43-15:38 UTC
Periodic jobs not working
Periodic jobs are working fine again.
Jun 5, 15:57-16:28 UTC
Scrapinghub API: filtering jobs by tag does not work as expected
Job filtering by tags is back to normal. Please report to help@scrapinghub.com if you experience any problems.
Jun 1, 08:45 - Jun 3, 11:26 UTC

May 2015

Dash maintenance resulted in downtime
A problem which occurred during maintenance resulted in intermittent downtime between 08:52 and 10:02 UTC.
May 21, 11:49 UTC

April 2015

No incidents reported for this month.

March 2015

No incidents reported for this month.

February 2015

Dash currently offline
Dash is now back online as of 16:20 UTC. We have yet to determine the cause but we will provide an update once we identify the problem.
Feb 27, 16:05-17:04 UTC
Dash - Periodic jobs not running
Problem has been resolved.
Feb 17, 12:33-15:36 UTC

January 2015

Dash is currently offline due to database issues
We have now resolved the problem and Dash is operational again.
Jan 21, 12:21-13:04 UTC
Dash - Jobs scheduled on the hour failed to run
A bug introduced into today's Dash release prevented scheduling of jobs which were set to run exactly on the hour (e.g. 09:00). Jobs scheduled for 10:00, 11:00, 12:00, and 13:00 UTC were affected. We have since resolved the issue and scheduled jobs should run as normal.
Jan 6, 14:16 UTC

December 2014

Crawlera bug
There was a configuration related bug in Monday's Crawlera release that resulted in 500 "request failed" errors for a number of spiders. We identified the cause and deployed a fix at 10:20 UTC this morning.
Dec 23, 12:44 UTC
Crawlera maintenance
This incident has been resolved.
Dec 15, 17:31-20:51 UTC
Failed Scrapy Cloud jobs
Between 4:00 UTC and 09:30 UTC today, some of our Scrapy Cloud users experienced jobs finishing with a "failed" outcome and a (rather cryptic) outcome "Process terminated with exit code 1, signal None, status=0x0100" We have identified the root cause (it was related to the size of the deployed projects) and the issue is now resolved.
Dec 3, 17:22 UTC

November 2014

Crawlera is currently down
Crawlera is fully functional again.
Nov 26, 19:57-20:27 UTC

October 2014

Verifying upgrade of Scrapy Cloud platform
Scrapy Cloud is fully operational now.
Oct 21, 08:02-08:05 UTC
[Scheduled] Scrapy Cloud Scheduled Downtime
The scheduled maintenance has been completed.
Oct 21, 06:30-08:00 UTC

September 2014

No incidents reported for this month.

August 2014

No incidents reported for this month.

July 2014

No incidents reported for this month.

June 2014

No incidents reported for this month.