Log In Sign Up

efind.ru
robots.txt

Robots Exclusion Standard data for efind.ru

Resource Scan

Scan Details

Site Domain efind.ru
Base Domain efind.ru
Scan Status Ok
Last Scan2024-11-13T18:09:36+00:00
Next Scan 2024-12-13T18:09:36+00:00

Last Scan

Scanned2024-11-13T18:09:36+00:00
URL https://efind.ru/robots.txt
Domain IPs 104.22.36.181, 104.22.37.181, 172.67.6.249, 2606:4700:10::6816:24b5, 2606:4700:10::6816:25b5, 2606:4700:10::ac43:6f9
Response IP 172.67.6.249
Found Yes
Hash 0d6dca7beaa28306628e6cbeb06133bb330cadad471249362061c044699ac918
SimHash 6d90894743b3

Groups

yandexbot
bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yadirectfetcher

Rule Path
Disallow /

*

Rule Path
Disallow /pdfsearch/
Disallow /cart
Disallow /spray
Disallow /services/partnership/online/stocktest
Allow /*/*.js$
Allow /*/*.css$
Allow /*/*.jpg$
Allow /*/*.png$
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top