missmarycafe.com
robots.txt

Robots Exclusion Standard data for missmarycafe.com

Resource Scan

Scan Details

Site Domain missmarycafe.com
Base Domain missmarycafe.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-29T02:51:20+00:00
Next Scan 2024-11-27T02:51:20+00:00

Last Successful Scan

Scanned2023-02-06T08:06:29+00:00
URL https://missmarycafe.com/robots.txt
Domain IPs 104.26.0.102, 104.26.1.102, 172.67.74.187, 2606:4700:20::681a:166, 2606:4700:20::681a:66, 2606:4700:20::ac43:4abb
Response IP 172.67.74.187
Found Yes
Hash d8c10563b9183f70d61024483229a9bb7ae1a6d666af7690eb39609df79b930f
SimHash 6b00d820e3a2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10