petxu.com
robots.txt

Robots Exclusion Standard data for petxu.com

Resource Scan

Scan Details

Site Domain petxu.com
Base Domain petxu.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-04T09:19:58+00:00
Next Scan 2025-11-03T09:19:58+00:00

Last Successful Scan

Scanned2025-09-04T19:48:55+00:00
URL https://petxu.com/robots.txt
Domain IPs 104.21.29.123, 172.67.148.253, 2606:4700:3033::6815:1d7b, 2606:4700:3037::ac43:94fd
Response IP 104.21.29.123
Found Yes
Hash deeb56f81beccdd14b78c666dc924b31f251a24b63785663c0b6a6ced8019aeb
SimHash 6824d8008bb3

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/

twitterbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://petxu.com/sitemap.xml
sitemap https://petxu.com/sitemap.rss
sitemap https://petxu.com/sitemap.xml