awesomerespite.com
robots.txt

Robots Exclusion Standard data for awesomerespite.com

Resource Scan

Scan Details

Site Domain awesomerespite.com
Base Domain awesomerespite.com
Scan Status Ok
Last Scan2025-10-15T02:36:53+00:00
Next Scan 2025-11-14T02:36:53+00:00

Last Scan

Scanned2025-10-15T02:36:53+00:00
URL https://awesomerespite.com/robots.txt
Redirect https://www.cbpofarizonainc.com/about/robots.txt
Redirect Domain www.cbpofarizonainc.com
Redirect Base cbpofarizonainc.com
Domain IPs 104.21.87.96, 172.67.169.84, 2606:4700:3032::6815:5760, 2606:4700:3032::ac43:a954
Redirect IPs 104.21.68.26, 172.67.185.120, 2606:4700:3032::ac43:b978, 2606:4700:3033::6815:441a
Response IP 104.21.68.26
Found Yes
Hash 78be1938bc37b9de6f4dbd917c06ea89a2ac9d7ff4b7f320dd6e055bc90cd366
SimHash 6c54dc557393

Groups

googlebot

Rule Path
Disallow

googlebot-image
googlebot-mobile

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.cbpofarizonainc.com/about/sitemap.xml