Log In Sign Up

ivedu.ru
robots.txt

Robots Exclusion Standard data for ivedu.ru

Resource Scan

Scan Details

Site Domain ivedu.ru
Base Domain ivedu.ru
Scan Status Ok
Last Scan2024-09-08T20:28:16+00:00
Next Scan 2024-10-08T20:28:16+00:00

Last Scan

Scanned2024-09-08T20:28:16+00:00
URL http://ivedu.ru/robots.txt
Redirect http://www.ivedu.ru/robots.txt
Redirect Domain www.ivedu.ru
Redirect Base ivedu.ru
Domain IPs 87.255.247.194
Redirect IPs 87.255.247.194
Response IP 87.255.247.194
Found Yes
Hash 6ddebe82692670d17f1aa5e0dbf432882fc0ab0847c6c66d889b3abd985c25db
SimHash 874c9e80cd32

Groups

*

Rule Path
Disallow /use
Disallow /administration
Disallow /includes
Disallow /locale
Disallow /phpmyadmin
Disallow /lostpassword.php
Disallow /login.php
Disallow /register.php
Disallow /profile.php
Disallow /infusions/pro_download_panel/file.php

Other Records

Field Value
crawl-delay 0.5

mj12bot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

baidumobaider

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /
Back to top

Comments

  • robots.txt for http://www.rus-phpfusion.com
  • $Id: robots.txt,v 1.0.2 2009/02/15 19:30:19 GMT +3:00 ted Exp $
  • exclude some access-controlled areas
Back to top

Warnings

  • `host` is not a known field.
Back to top