canliskor.me
robots.txt

Robots Exclusion Standard data for canliskor.me

Resource Scan

Scan Details

Site Domain canliskor.me
Base Domain canliskor.me
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan1/28/2025, 7:01:35 AM
Next Scan 4/28/2025, 7:01:35 AM

Last Successful Scan

Scanned9/14/2023, 6:36:08 AM
URL https://canliskor.me/robots.txt
Domain IPs 104.21.81.86, 172.67.158.177, 2606:4700:3035::6815:5156, 2606:4700:3035::ac43:9eb1
Response IP 104.21.81.86
Found Yes
Hash 0449f404402d347862ec513deb89b7571f61b9eedd72c7ce4d52001e7602cd20
SimHash 6f405c4683f1

Groups

*

Rule Path
Disallow /fixture_refresh/
Disallow /today_matches
Disallow /settings
Disallow /favorites
Disallow /live_data
Disallow /league

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://canliskor.me/sitemap.xml

Warnings

  • `host` is not a known field.