Log In Sign Up

ng58.ru
robots.txt

Robots Exclusion Standard data for ng58.ru

Resource Scan

Scan Details

Site Domain ng58.ru
Base Domain ng58.ru
Scan Status Ok
Last Scan2024-09-13T20:11:37+00:00
Next Scan 2024-10-13T20:11:37+00:00

Last Scan

Scanned2024-09-13T20:11:37+00:00
URL http://ng58.ru/robots.txt
Domain IPs 81.200.248.107
Response IP 81.200.248.107
Found Yes
Hash 66643724770a15816ec0efb1675b000f628f869262061d8cd11d1440a9eec44e
SimHash 2b8c1d008691

Groups

*

Rule Path
Disallow /bitrix/
Disallow /bitrix_personal/
Disallow /stat/
Disallow /upload/tmp/
Disallow /test/
Disallow /forum/users/
Disallow /login/
Disallow /subscribe/
Disallow /*?sphrase_id
Disallow /ads/my/
Disallow /regis_company.php
Disallow /*.swf
Disallow /search/

Other Records

Field Value
crawl-delay 5.0

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5.0

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5.0

yandexmedia

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 9.0

yandeximages

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 9.0

yandexblogs

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 9.0

yandexnews

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 9.0

yandexmarket

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 9.0
Back to top

Other Records

Field Value
sitemap http://ng58.ru/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top