cyclic.sh
robots.txt

Robots Exclusion Standard data for cyclic.sh

Resource Scan

Scan Details

Site Domain cyclic.sh
Base Domain cyclic.sh
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-10-23T16:35:25+00:00
Next Scan 2024-12-22T16:35:25+00:00

Last Successful Scan

Scanned2024-08-02T16:31:46+00:00
URL https://cyclic.sh/robots.txt
Redirect https://www.cyclic.sh/robots.txt
Redirect Domain www.cyclic.sh
Redirect Base cyclic.sh
Domain IPs 185.199.108.153, 185.199.109.153, 185.199.110.153, 185.199.111.153
Redirect IPs 185.199.108.153, 185.199.109.153, 185.199.110.153, 185.199.111.153
Response IP 185.199.111.153
Found Yes
Hash 2f4f6b5cbef28496aca87f14db7f50164c93d2e5debac6db66dc0a3e1ad4df23
SimHash a3289c12c517

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.cyclic.sh/sitemap.xml

Comments

  • Allow crawling of site by anyone