cafonline.com
robots.txt

Robots Exclusion Standard data for cafonline.com

Resource Scan

Scan Details

Site Domain cafonline.com
Base Domain cafonline.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-11-12T08:50:55+00:00
Next Scan 2024-11-26T08:50:55+00:00

Last Successful Scan

Scanned2024-10-04T17:01:32+00:00
URL https://www.cafonline.com/robots.txt
Domain IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.70
Found Yes
Hash fa9dd1b54a8da9a1f2368acbd97afe39ee6f5e560bb136274832e3c591687a90
SimHash 6d4cdc55e713

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.cafonline.com/site-map/