selfpublishingadvice.org
robots.txt

Robots Exclusion Standard data for selfpublishingadvice.org

Resource Scan

Scan Details

Site Domain selfpublishingadvice.org
Base Domain selfpublishingadvice.org
Scan Status Ok
Last Scan2024-04-22T16:51:17+00:00
Next Scan 2024-05-22T16:51:17+00:00

Last Scan

Scanned2024-04-22T16:51:17+00:00
URL https://selfpublishingadvice.org/robots.txt
Domain IPs 104.26.0.172, 104.26.1.172, 172.67.75.42, 2606:4700:20::681a:1ac, 2606:4700:20::681a:ac, 2606:4700:20::ac43:4b2a
Response IP 104.26.0.172
Found Yes
Hash bd352e420c27333ab8febc3df549a4510cf4c7001973fdf40127b507cbeeed99
SimHash 6101da028bb3

Groups

scrapy

Rule Path
Allow /

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://selfpublishingadvice.org/sitemap_index.xml