nikita-shop.ru
robots.txt

Robots Exclusion Standard data for nikita-shop.ru

Resource Scan

Scan Details

Site Domain nikita-shop.ru
Base Domain nikita-shop.ru
Scan Status Ok
Last Scan2024-10-22T00:55:13+00:00
Next Scan 2024-11-21T00:55:13+00:00

Last Scan

Scanned2024-10-22T00:55:13+00:00
URL https://nikita-shop.ru/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:4:c618, 2a00:15f8:a000:5:1:12:4:c618, 2a00:15f8:a000:5:1:13:4:c618, 2a00:15f8:a000:5:1:14:4:c618, 90.156.201.48, 90.156.201.59, 90.156.201.93, 90.156.201.98
Response IP 90.156.201.59
Found Yes
Hash 10ef2fd8c1c3d0809dde8d1cf47d092f778ef5e7d64924b1fd65f3e398d62914
SimHash cd11fe20c9a3

Groups

*

Rule Path
Disallow /admin
Disallow /_admin/
Disallow /members
Disallow /search
Disallow /subscribe
Disallow /users
Disallow /*offset%3D0
Disallow /*forum_ext%3D
Disallow /*_print_version%3D
Disallow /*action%3Dexport_rss
Disallow /*action%3Dsearch
Disallow /*action%3Dview_posts
Disallow /*display_form%3D
Disallow /*?action
Disallow /*?offset

yandex

Rule Path
Disallow /admin
Disallow /_admin/
Disallow /members
Disallow /search
Disallow /subscribe
Disallow /users
Disallow /*forum_ext%3D
Disallow /*offset%3D0
Disallow /*_print_version%3D
Disallow /*action%3Dexport_rss
Disallow /*action%3Dsearch
Disallow /*action%3Dview_posts
Disallow /*display_form%3D
Disallow /*?action
Disallow /*?offset

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.nikita-shop.ru/sitemap.xml

Warnings

  • `host` is not a known field.