wagpets.com
robots.txt

Robots Exclusion Standard data for wagpets.com

Resource Scan

Scan Details

Site Domain wagpets.com
Base Domain wagpets.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2024-06-03T04:35:22+00:00
Next Scan 2024-06-10T04:35:22+00:00

Last Successful Scan

Scanned2024-05-26T04:34:59+00:00
URL https://wagpets.com/robots.txt
Redirect https://www.wagpets.com/robots.txt
Redirect Domain www.wagpets.com
Redirect Base wagpets.com
Domain IPs 13.224.163.12, 13.224.163.122, 13.224.163.17, 13.224.163.73
Redirect IPs 108.157.254.32, 108.157.254.46, 108.157.254.52, 108.157.254.65
Response IP 108.157.254.65
Found Yes
Hash a9362a12ee4e49b39bb63b7bb596c1829c6752c5179c7f0a23da4094611dd1e3
SimHash 4901ca6029b3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.wagpets.com/sitemap.xml
sitemap https://www.wagpets.com/news-sitemap.xml