Log In Sign Up

klik-test.ru
robots.txt

Robots Exclusion Standard data for klik-test.ru

Resource Scan

Scan Details

Site Domain klik-test.ru
Base Domain klik-test.ru
Scan Status Ok
Last Scan2024-10-04T08:19:57+00:00
Next Scan 2024-10-11T08:19:57+00:00

Last Scan

Scanned2024-10-04T08:19:57+00:00
URL https://klik-test.ru/robots.txt
Domain IPs 104.21.73.182, 172.67.165.62
Response IP 172.67.165.62
Found Yes
Hash 630e4b7f831e23b7727fff270f0f9b8c683c36d92faa33902eef6dc08642a84f
SimHash 65099c42a791

Groups

yandex

Rule Path
Disallow *.html?*
Disallow *?
Disallow /js
Disallow /img
Disallow /css
Disallow /memes
Disallow /cdn-cgi/

Other Records

Field Value
crawl-delay 2

*

Rule Path
Disallow *.html?*
Disallow *?
Disallow /js
Disallow /img
Disallow /css
Disallow /memes
Disallow /cdn-cgi/
Back to top

Other Records

Field Value
sitemap https://klik-test.ru/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top