catchtable.net
robots.txt

Robots Exclusion Standard data for catchtable.net

Resource Scan

Scan Details

Site Domain catchtable.net
Base Domain catchtable.net
Scan Status Ok
Last Scan2024-09-13T13:13:58+00:00
Next Scan 2024-10-13T13:13:58+00:00

Last Scan

Scanned2024-09-13T13:13:58+00:00
URL https://catchtable.net/robots.txt
Redirect https://www.catchtable.net:443/robots.txt
Redirect Domain www.catchtable.net
Redirect Base catchtable.net
Domain IPs 3.36.143.121, 43.201.192.215, 54.180.225.122
Redirect IPs 104.18.12.188, 104.18.13.188
Response IP 104.18.12.188
Found Yes
Hash 0defaa8577544bf3cefcfa101a3a63b0358b41f860d6b4ef101b1f334baa50c7
SimHash c0145b018391

Groups

googlebot
yeti
bingbot
daumoa
slurp
baiduspider
applebot
zumbot

Rule Path
Allow /
Allow /shop/
Allow /searchList/
Allow /search/
Allow /curation/
Disallow /my-dining/
Disallow /my/
Disallow /shop/menu/
Disallow /stories/view/

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.catchtable.net/sitemap.xml