discover.surfline.com
robots.txt

Robots Exclusion Standard data for discover.surfline.com

Resource Scan

Scan Details

Site Domain discover.surfline.com
Base Domain surfline.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-04-19T23:07:21+00:00
Next Scan 2024-06-18T23:07:21+00:00

Last Successful Scan

Scanned2024-01-28T22:42:00+00:00
URL http://discover.surfline.com/robots.txt
Domain IPs 13.215.233.24, 3.0.211.1
Response IP 52.58.166.50
Found Yes
Hash a2ae84469ff43954fcf371fd33c23e79f6d83a4c149d99ba0b756e48183afa39
SimHash b1209c44e9b2

Groups

*

Rule Path
Disallow */clkn/*
Disallow */clkg/*