re.cankalp.com
robots.txt

Robots Exclusion Standard data for re.cankalp.com

Resource Scan

Scan Details

Site Domain re.cankalp.com
Base Domain cankalp.com
Scan Status Ok
Last Scan2025-12-08T23:23:05+00:00
Next Scan 2026-01-07T23:23:05+00:00

Last Scan

Scanned2025-12-08T23:23:05+00:00
URL https://re.cankalp.com/robots.txt
Domain IPs 216.150.1.1, 216.150.16.1
Response IP 216.150.16.1
Found Yes
Hash 6041aaabcbeb241c88541569b1122c574d0080ad66883e911b694fc6b11e74e4
SimHash 281d8711c5a3

Groups

*

Rule Path
Allow /
Allow /novels/
Allow /index.html
Disallow /novels-cache.json
Disallow /.git/

Other Records

Field Value
sitemap https://re.cankalp.com/sitemap.xml

Comments

  • Sitemap
  • Allow all search engines to crawl the site
  • Disallow crawling of cache and temporary files