xiaoshuocc.com
robots.txt

Robots Exclusion Standard data for xiaoshuocc.com

Resource Scan

Scan Details

Site Domain xiaoshuocc.com
Base Domain xiaoshuocc.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan4/6/2025, 8:27:47 AM
Next Scan 7/5/2025, 8:27:47 AM

Last Successful Scan

Scanned9/9/2024, 6:10:05 AM
URL https://xiaoshuocc.com/robots.txt
Redirect http://www.xiaoshuocc.com/robots.txt
Redirect Domain www.xiaoshuocc.com
Redirect Base xiaoshuocc.com
Domain IPs 104.21.79.94, 172.67.143.15, 2606:4700:3035::6815:4f5e, 2606:4700:3037::ac43:8f0f
Redirect IPs 104.21.79.94, 172.67.143.15, 2606:4700:3035::6815:4f5e, 2606:4700:3037::ac43:8f0f
Response IP 172.67.143.15
Found Yes
Hash b3588497ffd4c49ec2c7b5b0bbca5b50fcf2bbed21244ad3be3cc09eb86680fa
SimHash 1a1f8c601a93

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

screenerbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap /sitemap.xml
sitemap /site.txt

Warnings

  • 4 invalid lines.