butterdog.xyz
robots.txt

Robots Exclusion Standard data for butterdog.xyz

Resource Scan

Scan Details

Site Domain butterdog.xyz
Base Domain butterdog.xyz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-01T22:04:27+00:00
Next Scan 2025-07-30T22:04:27+00:00

Last Successful Scan

Scanned2023-12-16T15:34:47+00:00
URL https://butterdog.xyz/robots.txt
Domain IPs 104.21.79.15, 172.67.140.7, 2606:4700:3031::6815:4f0f, 2606:4700:3035::ac43:8c07
Response IP 172.67.140.7
Found Yes
Hash e139bc40fd9dd1bb4b5267f91cdc94438ba861af8162760df6d4f1eac543203a
SimHash 4101d8404992

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://butterdog.xyz/index.php/sitemap_index.xml