Log In Sign Up

search-world.ru
robots.txt

Robots Exclusion Standard data for search-world.ru

Resource Scan

Scan Details

Site Domain search-world.ru
Base Domain search-world.ru
Scan Status Ok
Last Scan2024-10-31T12:11:54+00:00
Next Scan 2024-11-07T12:11:54+00:00

Last Scan

Scanned2024-10-31T12:11:54+00:00
URL http://search-world.ru/robots.txt
Domain IPs 91.206.14.160
Response IP 91.206.14.160
Found Yes
Hash 7f9076b1e3f91f795d3d2ef3bb9c77dea1c8d7a82d13bd8d80cc1be23df6c04b
SimHash 0304df854f1e

Groups

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /
Allow *favicon*

yandexmedia

Rule Path
Disallow /
Allow *favicon*

tineye-bot

Rule Path
Disallow /

tineye

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap http://search-world.ru/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top