miaoj6.com
robots.txt

Robots Exclusion Standard data for miaoj6.com

Resource Scan

Scan Details

Site Domain miaoj6.com
Base Domain miaoj6.com
Scan Status Ok
Last Scan2024-09-03T10:17:05+00:00
Next Scan 2024-10-03T10:17:05+00:00

Last Scan

Scanned2024-09-03T10:17:05+00:00
URL https://www.miaoj6.com/robots.txt
Redirect https://www.mjxiaoshuo6.com/robots.txt
Redirect Domain www.mjxiaoshuo6.com
Redirect Base mjxiaoshuo6.com
Domain IPs 104.21.65.236, 172.67.152.197, 2606:4700:3032::ac43:98c5, 2606:4700:3033::6815:41ec
Redirect IPs 104.21.62.125, 172.67.223.198, 2606:4700:3032::ac43:dfc6, 2606:4700:3034::6815:3e7d
Response IP 104.21.62.125
Found Yes
Hash 30ee47e6b7a04fc0e9f617dd89dac0a29d8fbf15b4cc6a3a999763206d5bf5ff
SimHash 1a5d84c05cc1

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

yahoo

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

screenerbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap /sitemap.xml
sitemap /site.txt

Warnings

  • 2 invalid lines.