November 12, 2021

SiteGround and Googlebot DNS problems, sites losing indexing.

There is a serious problem with Siteground hosting right now, with Google no longer indexing sites hosted by SiteGround since last Monday

SiteGround DNS problems

SiteGround has confirmed a serious problem that has prevented Googlebot from crawling many sites hosted there since Monday. Publishers panic when e-commerce store web pages and products leave Google.

SiteGround has posted various updates to the problem, but it is not yet clear what exactly is causing the problem. This in turn is causing more concern in some publishers who tweet that they are done and move to other WordPress hosting.

The problem I see is that Googlebot is unable to retrieve the site's current robots.txt file and therefore does not crawl the site or go back to an older version of the robots.txt file.

The problem apparently started on Monday

The problem on SiteGround started on Monday when publishers noticed that Google had stopped crawling their sites.

SiteGround initially denies the problem, but eventually admits

SiteGround initially tweeted Wednesday that they couldn't identify any problems on their part.

SiteGround has replied on Twitter :

“We have received reports that a number of Google bot networks are unable to crawl some websites using our DNS service.

After a thorough check of our DNS, we can confirm that there are no blocks on our part preventing this scan, nor do we see any logs suggesting a problem with our systems. "

SiteGround “forwards” the problem to Google

SiteGround then forwarded the issue to Google, apparently assuming the issue was there and that Google could fix it.

SiteGround has published :

“We have forwarded the issue to Google and are working to resolve and identify the cause of the issue. We will keep you updated as soon as we have more information or the problem is resolved. "

SiteGround denies the problem again in the end

SiteGround then distanced itself from the problem with a subsequent tweet to essentially say they can't fix it because nothing at their end is broken.

SiteGround has tweeted : 

“Problems that originate outside our environment are quite difficult to predict, but we fully understand the inconvenience they cause. We will update our official post with more information once it becomes available: "

The problem was not widespread and did not affect other web hosts. This was happening at SiteGround, which could indicate a SiteGround-specific problem, although it may not be within the SiteGround systems themselves.

SiteGround passes the ball to AWS and Google

Eventually SiteGround seemed to identify a problem on Thursday morning, tweeting : 

“Update on the problem reported by some users with Google bots unable to crawl their sites: lo
we traced it to a network issue between the AWS Global Accelerator service and Google. We are working with engineers from both teams to fix it. We appreciate your patience! "

A customer tweeted that he felt SiteGround may not have identified the problem and posted a screenshot of an email he received:

SiteGround's customers are losing patience

Understandably, SiteGround's customers have long since lost patience with many tweeting their state of horror, shock and despair:

Real effect on a SiteGround customer who asked us for help

We received about 20 requests for help from yesterday and today SiteGround customers deeply disappointed from this problem with major damage to positioning and organic traffic.

Here is a Screen that shows how since 11 November the site is literally dead.

SiteGround organic traffic loss

Solution to the problem?

A SiteGround customer seemed to confirm that the issue is related to SiteGround's DNS and that moving their website's DNS to an external DNS solved the problem:

At the time of writing, the problem is still ongoing.

Update at 14:40 on November 12th

We had a lot of customer inquiries that we went through on our Hostings yesterday, mentioning that the site again points to SiteGround hosting and not ours.

By checking the DNS zone of the domain still on SiteGround, it appears that the DNS zone has been updated by resetting the changes we made.

This is probably due to the resolution operations that SiteGround is doing, but which in this case with the sites already migrated to external Hosting are only creating further problems to the already problems created by the proceeding problem that we have covered in this article.

If you "live" from organic traffic it is better if you intervene IMMEDIATELY. Taking action TODAY should protect you from disaster.
It is not a situation to wait in.
Contact us immediately at 3409854556 you will have an expert systems engineer to help you immediately in managing the emergency and solve the problem within the day.

Do you have doubts? Don't know where to start? Contact us!

We have all the answers to your questions to help you make the right choice.

Chat with us

Chat directly with our presales support.

0256569681

Contact us by phone during office hours 9:30 - 19:30

Contact us online

Open a request directly in the contact area.

INFORMATION

Managed Server Srl is a leading Italian player in providing advanced GNU/Linux system solutions oriented towards high performance. With a low-cost and predictable subscription model, we ensure that our customers have access to advanced technologies in hosting, dedicated servers and cloud services. In addition to this, we offer systems consultancy on Linux systems and specialized maintenance in DBMS, IT Security, Cloud and much more. We stand out for our expertise in hosting leading Open Source CMS such as WordPress, WooCommerce, Drupal, Prestashop, Joomla, OpenCart and Magento, supported by a high-level support and consultancy service suitable for Public Administration, SMEs and any size.

Red Hat, Inc. owns the rights to Red Hat®, RHEL®, RedHat Linux®, and CentOS®; AlmaLinux™ is a trademark of AlmaLinux OS Foundation; Rocky Linux® is a registered trademark of the Rocky Linux Foundation; SUSE® is a registered trademark of SUSE LLC; Canonical Ltd. owns the rights to Ubuntu®; Software in the Public Interest, Inc. holds the rights to Debian®; Linus Torvalds owns the rights to Linux®; FreeBSD® is a registered trademark of The FreeBSD Foundation; NetBSD® is a registered trademark of The NetBSD Foundation; OpenBSD® is a registered trademark of Theo de Raadt. Oracle Corporation owns the rights to Oracle®, MySQL®, and MyRocks®; Percona® is a registered trademark of Percona LLC; MariaDB® is a registered trademark of MariaDB Corporation Ab; REDIS® is a registered trademark of Redis Labs Ltd. F5 Networks, Inc. owns the rights to NGINX® and NGINX Plus®; Varnish® is a registered trademark of Varnish Software AB. Adobe Inc. holds the rights to Magento®; PrestaShop® is a registered trademark of PrestaShop SA; OpenCart® is a registered trademark of OpenCart Limited. Automattic Inc. owns the rights to WordPress®, WooCommerce®, and JetPack®; Open Source Matters, Inc. owns the rights to Joomla®; Dries Buytaert holds the rights to Drupal®. Amazon Web Services, Inc. holds the rights to AWS®; Google LLC holds the rights to Google Cloud™ and Chrome™; Facebook, Inc. owns the rights to Facebook®; Microsoft Corporation holds the rights to Microsoft®, Azure®, and Internet Explorer®; Mozilla Foundation owns the rights to Firefox®. Apache® is a registered trademark of The Apache Software Foundation; PHP® is a registered trademark of the PHP Group. CloudFlare® is a registered trademark of Cloudflare, Inc.; NETSCOUT® is a registered trademark of NETSCOUT Systems Inc.; ElasticSearch®, LogStash®, and Kibana® are registered trademarks of Elastic NV This site is not affiliated, sponsored, or otherwise associated with any of the entities mentioned above and does not represent any of these entities in any way. All rights to the brands and product names mentioned are the property of their respective copyright holders. Any other trademarks mentioned belong to their registrants. MANAGED SERVER® is a registered trademark at European level by MANAGED SERVER SRL Via Enzo Ferrari, 9 62012 Civitanova Marche (MC) Italy.

JUST A MOMENT !

Would you like to see how your WooCommerce runs on our systems without having to migrate anything? 

Enter the address of your WooCommerce site and you will get a navigable demonstration, without having to do absolutely anything and completely free.

No thanks, my customers prefer the slow site.
Back to top