cossackdom.com
robots.txt

Robots Exclusion Standard data for cossackdom.com

Resource Scan

Scan Details

Site Domain cossackdom.com
Base Domain cossackdom.com
Scan Status Ok
Last Scan2025-06-02T09:00:42+00:00
Next Scan 2025-07-02T09:00:42+00:00

Last Scan

Scanned2025-06-02T09:00:42+00:00
URL http://cossackdom.com/robots.txt
Domain IPs 2a01:4f8:141:13bb::1, 46.4.115.183
Response IP 46.4.115.183
Found Yes
Hash 3d0e83ea8e655a2d5cb059130c61e339c47b03a1e9b4ee7b064c8e4342c6ea6b
SimHash 4d52ef63c797

Groups

*

Rule Path
Allow /
Disallow /db/auth/
Disallow /db/comp/items.html
Disallow /cgi-bin/
Disallow /pda/
Disallow /cgi-sys/
Disallow /*.files/
Disallow /*.files/*
Disallow /*?
Disallow /*?*
Disallow /*_notes/
Disallow /*_notes/*
Disallow /analyticstracking

yandex

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /cgi-sys/
Disallow /*.files/
Disallow /*.files/*
Disallow /*?
Disallow /*?*
Disallow /*_notes/
Disallow /*_notes/*
Disallow /analyticstracking

Other Records

Field Value Comment
crawl-delay 1 задает таймаут в 2 секунды

Other Records

Field Value
sitemap http://cossackdom.com/sitemap.xml
sitemap http://cossackdom.com/sitemap.xml

Warnings

  • `host` is not a known field.