petreferred.com
robots.txt

Robots Exclusion Standard data for petreferred.com

Resource Scan

Scan Details

Site Domain petreferred.com
Base Domain petreferred.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-01T19:28:23+00:00
Next Scan 2024-10-30T19:28:23+00:00

Last Successful Scan

Scanned2023-01-08T15:06:09+00:00
URL https://www.petreferred.com/robots.txt
Domain IPs 104.21.51.63, 172.67.222.226, 2606:4700:3033::6815:333f, 2606:4700:3033::ac43:dee2
Response IP 104.21.51.63
Found Yes
Hash a57ebe9d8964ddee722da1e3db523bca2baec23a737bd4c3830f3bb0897972e2
SimHash 61005c008993

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://petreferred.com/sitemap_index.xml