lenanitro.live
robots.txt

Robots Exclusion Standard data for lenanitro.live

Resource Scan

Scan Details

Site Domain lenanitro.live
Base Domain lenanitro.live
Scan Status Ok
Last Scan2024-05-19T03:26:29+00:00
Next Scan 2024-06-18T03:26:29+00:00

Last Scan

Scanned2024-05-19T03:26:29+00:00
URL https://lenanitro.live/robots.txt
Domain IPs 108.138.246.111, 108.138.246.116, 108.138.246.69, 108.138.246.73
Response IP 108.157.60.17
Found Yes
Hash 277054733411bc5b73f5d69d066841605452df714bbf82559867b280d0371e81
SimHash 211ec8242beb

Groups

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sougou

Rule Path
Disallow /

bingbot

Rule Path
Disallow /es/
Disallow /fr/
Disallow /it/
Disallow /tr/
Disallow /no/
Disallow /nl/

Other Records

Field Value
crawl-delay 90

*

Rule Path
Disallow /es/
Disallow /fr/
Disallow /it/
Disallow /tr/
Disallow /no/
Disallow /nl/

Other Records

Field Value
crawl-delay 30

Comments

  • GUPPYWEB2