Log In Sign Up

xian.inc
robots.txt

Robots Exclusion Standard data for xian.inc

Resource Scan

Scan Details

Site Domain xian.inc
Base Domain xian.inc
Scan Status Ok
Last Scan2024-09-22T17:59:26+00:00
Next Scan 2024-10-06T17:59:26+00:00

Last Scan

Scanned2024-09-22T17:59:26+00:00
URL https://xian.inc/robots.txt
Domain IPs 34.120.251.130
Response IP 34.120.251.130
Found Yes
Hash 8e23a18b82dbfe101435cab75199c9dbd3d569f790813f735dd0618ae854ded9
SimHash b2850d8575d0

Groups

*

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://xian.inc/shared/sitemap.xml
Back to top

Comments

  • See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • Disallow: /
Back to top