kam24.ru
robots.txt

Robots Exclusion Standard data for kam24.ru

Resource Scan

Scan Details

Site Domain kam24.ru
Base Domain kam24.ru
Scan Status Ok
Last Scan2024-06-19T18:35:31+00:00
Next Scan 2024-06-26T18:35:31+00:00

Last Scan

Scanned2024-06-19T18:35:31+00:00
URL https://kam24.ru/robots.txt
Domain IPs 104.21.25.247, 172.67.134.240, 2606:4700:3032::ac43:86f0, 2606:4700:3035::6815:19f7
Response IP 104.21.25.247
Found Yes
Hash 70a1d75680bbf747e8d4fb40f5575a15e2f9a1a132bc2cf2d3bf332315fbf2f7
SimHash ecd2de21d330

Groups

*

Rule Path
Disallow /themes/
Disallow /assets/
Disallow /protected/
Disallow /forum/
Disallow /Content/forum
Disallow /uploads/

Other Records

Field Value
crawl-delay 0.5

googlebot-image

Rule Path
Disallow /

yandex

Rule Path
Disallow /uploads$
Disallow /uploads/
Disallow /themes/
Disallow /assets/
Disallow /protected/
Disallow /forum/
Disallow /Content/forum

yandeximages

Rule Path
Disallow /

mozilla/5.0 (compatible; linux x86_64; zen_bot/2.0;+https://help.mail.ru/webmaster/indexing/robots)

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0.1

Warnings

  • `host` is not a known field.