Log In Sign Up

blog.gov.uk
robots.txt

Robots Exclusion Standard data for blog.gov.uk

Resource Scan

Scan Details

Site Domain blog.gov.uk
Base Domain blog.gov.uk
Scan Status Ok
Last Scan2024-05-03T19:11:47+00:00
Next Scan 2024-06-02T19:11:47+00:00

Last Scan

Scanned2024-05-03T19:11:47+00:00
URL https://blog.gov.uk/robots.txt
Redirect https://www.blog.gov.uk/robots.txt
Redirect Domain www.blog.gov.uk
Redirect Base blog.gov.uk
Domain IPs 75.2.35.174, 99.83.196.32
Redirect IPs 13.225.142.105, 13.225.142.108, 13.225.142.29, 13.225.142.8, 2600:9000:21eb:7800:16:702d:4080:93a1, 2600:9000:21eb:8600:16:702d:4080:93a1, 2600:9000:21eb:9a00:16:702d:4080:93a1, 2600:9000:21eb:b200:16:702d:4080:93a1, 2600:9000:21eb:b600:16:702d:4080:93a1, 2600:9000:21eb:bc00:16:702d:4080:93a1, 2600:9000:21eb:de00:16:702d:4080:93a1, 2600:9000:21eb:e200:16:702d:4080:93a1
Response IP 18.165.171.31
Found Yes
Hash 0421de2bd3aaa82ae2a99ec698cd2a85dce3162ebfe2878eeaa132d3ee2d868b
SimHash f930ba2e17b0

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow */xmlrpc.php
Disallow */wp-*.php
Disallow */trackback/
Disallow *?wptheme=
Disallow *?comments=
Disallow *?replytocom
Disallow */comment-page-
Disallow *?s=

magpie-crawler

Rule Path
Allow /

twitterbot

Rule Path
Disallow
Back to top

Comments

  • XML Sitemap & Google News version 5.4.6 - https://status301.net/wordpress-plugins/xml-sitemap-feed/
  • No XML Sitemaps are enabled.
Back to top

Warnings

  • 1 invalid line.
Back to top