biellagavin.blog
robots.txt

Robots Exclusion Standard data for biellagavin.blog

Resource Scan

Scan Details

Site Domain biellagavin.blog
Base Domain biellagavin.blog
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-28T06:53:48+00:00
Next Scan 2025-01-26T06:53:48+00:00

Last Successful Scan

Scanned2022-11-27T12:44:02+00:00
URL https://biellagavin.blog/robots.txt
Response IP 192.0.78.24, 192.0.78.25
Found Yes
Hash 8b9a54b21d5690880a666a73d4dd321248683fbce3000b9fe4d866fa56fd12ad
SimHash b3169b0c2ef7

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-login.php
Disallow /wp-signup.php
Disallow /press-this.php
Disallow /remote-login.php
Disallow /activate/
Disallow /cgi-bin/
Disallow /mshots/v1/
Disallow /next/
Disallow /public.api/

Other Records

Field Value
sitemap https://biellagavin.blog/sitemap.xml
sitemap https://biellagavin.blog/news-sitemap.xml

Comments

  • If you are regularly crawling WordPress.com sites, please use our firehose to receive real-time push updates instead.
  • Please see https://developer.wordpress.com/docs/firehose/ for more details.
  • This file was generated on Sun, 27 Nov 2022 12:44:02 +0000