cliti.info
robots.txt

Robots Exclusion Standard data for cliti.info

Resource Scan

Scan Details

Site Domain cliti.info
Base Domain cliti.info
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-03-28T16:58:18+00:00
Next Scan 2025-05-27T16:58:18+00:00

Last Successful Scan

Scanned2025-01-05T11:28:42+00:00
URL https://cliti.info/robots.txt
Domain IPs 104.21.8.247, 172.67.188.216, 2606:4700:3030::ac43:bcd8, 2606:4700:3032::6815:8f7
Response IP 172.67.188.216
Found Yes
Hash acd7fb209f075a2bd0f74e4ad0c8c62b5678c2ce68afae74b26c9dd5eaa01819
SimHash 6e099a40c3b0

Groups

yandex

Rule Path
Disallow /cdn/cliti/*

Other Records

Field Value
crawl-delay 2.0

bingbot

Rule Path
Disallow /cdn/cliti/*

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /cdn/cliti/*

Other Records

Field Value
sitemap https://cliti.info/sitemap.xml

Warnings

  • `host` is not a known field.