wot-numbers.com
robots.txt

Robots Exclusion Standard data for wot-numbers.com

Resource Scan

Scan Details

Site Domain wot-numbers.com
Base Domain wot-numbers.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-26T10:45:36+00:00
Next Scan 2025-05-25T10:45:36+00:00

Last Successful Scan

Scanned2024-05-31T10:43:00+00:00
URL https://wot-numbers.com/robots.txt
Domain IPs 104.21.94.9, 172.67.217.207, 2606:4700:3036::6815:5e09, 2606:4700:3036::ac43:d9cf
Response IP 172.67.217.207
Found Yes
Hash 2267771eebdadfc2244baa6ff7ad064bcd2d00c5018e761f6a729458271c44de
SimHash 4a78dc42f231

Groups

*

Rule Path
Allow

Other Records

Field Value
crawl-delay 2

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Comments

  • Block MegaIndex.ru