5port.ru
robots.txt

Robots Exclusion Standard data for 5port.ru

Resource Scan

Scan Details

Site Domain 5port.ru
Base Domain 5port.ru
Scan Status Ok
Last Scan2024-05-23T12:27:28+00:00
Next Scan 2024-06-22T12:27:28+00:00

Last Scan

Scanned2024-05-23T12:27:28+00:00
URL http://5port.ru/robots.txt
Redirect https://www.koob.ru/robots.txt
Redirect Domain www.koob.ru
Redirect Base koob.ru
Domain IPs 2a00:15f8:a000:5:1:11:4:14e3, 2a00:15f8:a000:5:1:12:4:14e3, 2a00:15f8:a000:5:1:13:4:14e3, 2a00:15f8:a000:5:1:14:4:14e3, 90.156.201.49, 90.156.201.66, 90.156.201.98, 90.156.201.99
Redirect IPs 89.108.94.98
Response IP 89.108.94.98
Found Yes
Hash 17ae7099f0a46f49afa905bfac8f03c3f3331f16af63e53bce5359763ff7ff4c
SimHash 3256c8e39999

Groups

*

Rule Path
Disallow /at/
Disallow /click.php
Disallow /search/
Disallow /search.php
Disallow /foto/rkl
Disallow /news/?page=
Disallow /experiment-d.php
Disallow /exchange/
Disallow /exchange1/
Disallow /images/
Disallow /js/

yandex

Rule Path
Disallow /at/
Disallow /click.php
Disallow /search/
Disallow /search.php
Disallow /foto/rkl
Disallow /news/?page=
Disallow /experiment-d.php
Disallow /exchange/
Disallow /exchange1/
Disallow /images/
Disallow /js/

archive.org_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

deusu

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ranksonicbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.