Log In Sign Up

kdan.com
robots.txt

Robots Exclusion Standard data for kdan.com

Resource Scan

Scan Details

Site Domain kdan.com
Base Domain kdan.com
Scan Status Ok
Last Scan2024-06-15T18:09:26+00:00
Next Scan 2024-06-22T18:09:26+00:00

Last Scan

Scanned2024-06-15T18:09:26+00:00
URL https://kdan.com/robots.txt
Redirect https://www.kdan.com/robots.txt
Redirect Domain www.kdan.com
Redirect Base kdan.com
Domain IPs 13.33.88.118, 13.33.88.20, 13.33.88.40, 13.33.88.63
Redirect IPs 13.33.88.118, 13.33.88.20, 13.33.88.40, 13.33.88.63
Response IP 13.33.88.63
Found Yes
Hash 19a49fa3e6670dac2a647fc3d8958ee00674aab622a51a7cdae6dc02f48def37
SimHash 66942d957fc4

Groups

*

Rule Path
Disallow /api/
Disallow /turns10
Disallow /products-embedded
Disallow /maintenance
Disallow /pdf-reader/license/success
Disallow /sh
Disallow /*/turns10
Disallow /*/products-embedded
Disallow /*/maintenance
Disallow /*/pdf-reader/license/success
Disallow /zh-cn/sh
Disallow /zh-CN/sh

googlebot

Rule Path
Disallow /*/wp-admin/
Allow /*/wp-admin/admin-ajax.php

bingbot

Rule Path
Disallow /*/wp-admin/
Allow /*/wp-admin/admin-ajax.php

twitterbot

Rule Path
Disallow /*/wp-admin/
Allow /*/wp-admin/admin-ajax.php

ahrefssiteaudit

Rule Path
Disallow /*/wp-admin/
Allow /*/wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://www.kdanmobile.com/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top