pastibisaamr.com
robots.txt

Robots Exclusion Standard data for pastibisaamr.com

Resource Scan

Scan Details

Site Domain pastibisaamr.com
Base Domain pastibisaamr.com
Scan Status Ok
Last Scan2025-04-02T21:18:31+00:00
Next Scan 2025-05-02T21:18:31+00:00

Last Scan

Scanned2025-04-02T21:18:31+00:00
URL https://pastibisaamr.com/robots.txt
Redirect https://www.cafehavanali.com/robots.txt
Redirect Domain www.cafehavanali.com
Redirect Base cafehavanali.com
Domain IPs 104.21.54.94, 172.67.137.186, 2606:4700:3031::6815:365e, 2606:4700:3035::ac43:89ba
Redirect IPs 66.29.137.18
Response IP 66.29.137.18
Found Yes
Hash e314770142e22352aba0eb35f59ff9703b5d690ba8f34a6f1efd14a4007e94aa
SimHash 6014dc5567d3

Groups

googlebot

Rule Path
Disallow

googlebot-image
googlebot-mobile

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.cafehavanali.com/sitemap.xml