mykerch.com
robots.txt

Robots Exclusion Standard data for mykerch.com

Resource Scan

Scan Details

Site Domain mykerch.com
Base Domain mykerch.com
Scan Status Ok
Last Scan2025-12-09T21:38:56+00:00
Next Scan 2025-12-16T21:38:56+00:00

Last Scan

Scanned2025-12-09T21:38:56+00:00
URL https://mykerch.com/robots.txt
Domain IPs 45.130.41.35
Response IP 45.130.41.35
Found Yes
Hash 7358c0b1f714854b0b6dd5fb386fec3b44767096359097b3344951eacce38847
SimHash 4b09eda28a31

Groups

*

Rule Path
Allow /
Disallow *.php
Disallow /admin
Disallow /admin/
Disallow /cache/
Disallow /cgi-bin
Disallow /components/
Disallow /core/
Disallow /filters/
Disallow /includes/
Disallow /languages/
Disallow /modules/
Disallow /plugins/
Disallow /templates
Disallow /uploads
Disallow /registration
Disallow /registration/
Disallow /passremind.html
Disallow /search
Disallow /search/tag/
Disallow /go
Disallow /go/
Disallow /rss/
Disallow /maps/abuse*.html
Disallow /maps/embed-code/*
Disallow /maps/compare/
Disallow /forum/thread*-1.html
Disallow /forum/*_activity.html
Disallow /login
Disallow /board/*/type/*
Disallow /users/*
Disallow /users/hobby/*
Disallow /users/city/*
Disallow /clubs/by_user_*
Disallow /includes/bbcode/player_mp3_mini.swf
Disallow /catalog/*/add.html
Disallow /catalog/*/tag/*
Disallow /orphus
Disallow /comments
Disallow /index.php

googlebot

Rule Path
Allow /

yandex

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap http://mykerch.com/google_sitemap.xml
sitemap http://mykerch.com/yandex_sitemap.xml

Warnings

  • `host` is not a known field.