lwxsww.com
robots.txt

Robots Exclusion Standard data for lwxsww.com

Resource Scan

Scan Details

Site Domain lwxsww.com
Base Domain lwxsww.com
Scan Status Ok
Last Scan2024-05-31T15:53:14+00:00
Next Scan 2024-06-30T15:53:14+00:00

Last Scan

Scanned2024-05-31T15:53:14+00:00
URL https://www.lwxsww.com/robots.txt
Redirect https://www.lwkankan.com/robots.txt
Redirect Domain www.lwkankan.com
Redirect Base lwkankan.com
Domain IPs 104.21.43.17, 172.67.215.217, 2606:4700:3031::6815:2b11, 2606:4700:3031::ac43:d7d9
Redirect IPs 104.21.17.177, 172.67.177.189, 2606:4700:3031::6815:11b1, 2606:4700:3032::ac43:b1bd
Response IP 104.21.17.177
Found Yes
Hash 30ee47e6b7a04fc0e9f617dd89dac0a29d8fbf15b4cc6a3a999763206d5bf5ff
SimHash 1a5d84c05cc1

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

yahoo

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

screenerbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap /sitemap.xml
sitemap /site.txt

Warnings

  • 2 invalid lines.