Log In Sign Up

рыбалтика.рф
robots.txt

Robots Exclusion Standard data for рыбалтика.рф

Resource Scan

Scan Details

Site Domain рыбалтика.рф
Base Domain рыбалтика.рф
Scan Status Ok
Last Scan2024-05-20T01:06:59+00:00
Next Scan 2024-06-19T01:06:59+00:00

Last Scan

Scanned2024-05-20T01:06:59+00:00
URL https://рыбалтика.рф/robots.txt
Redirect https://xn--80aab3ake6at1f.xn--p1ai/robots.txt
Domain IPs 104.21.90.7, 172.67.167.126, 2606:4700:3036::ac43:a77e, 2606:4700:3037::6815:5a07
Response IP 172.67.167.126
Found Yes
Hash aa230633003a10be2f992fb74d8fc9880aba5b447f35d8e9957c003e04f2d9a3
SimHash 2b52dececa96

Groups

*

Rule Path
Disallow /adm/
Disallow /faq.php
Disallow /mcp.php
Disallow /index.php?
Disallow /memberlist.php
Disallow /posting.php
Disallow /report.php
Disallow /search.php
Disallow /ucp.php
Disallow /viewonline.php
Disallow /*%26st%3D*
Disallow /*%26sk%3D*
Disallow /*%26sd%3D*
Disallow /*%26hilit%3D*
Disallow /*%26view%3D*
Disallow /viewtopic.php*p%3D*
Disallow /view*%26start%3D0$
Disallow /thankslist.php
Disallow /gallery/index.php?
Disallow /gallery/mcp.php
Disallow /gallery/search.php
Disallow /gallery/posting.php

Other Records

Field Value Comment
crawl-delay 4.0 задает таймаут в 4 секунды

googlebot-image

Rule Path
Disallow

Other Records

Field Value Comment
crawl-delay 4.0 задает таймаут в 4 секунды

mediapartners-google

Rule Path
Disallow

Other Records

Field Value Comment
crawl-delay 4.0 задает таймаут в 4 секунды
Back to top

Other Records

Field Value
sitemap https://xn--80aab3ake6at1f.xn--p1ai/sitemap.php
Back to top

Comments

  • Google Image
  • Google AdSense
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top