cs-mapping.com.ua
robots.txt

Robots Exclusion Standard data for cs-mapping.com.ua

Resource Scan

Scan Details

Site Domain cs-mapping.com.ua
Base Domain cs-mapping.com.ua
Scan Status Ok
Last Scan4/14/2025, 2:37:54 AM
Next Scan 4/21/2025, 2:37:54 AM

Last Scan

Scanned4/14/2025, 2:37:54 AM
URL https://cs-mapping.com.ua/robots.txt
Domain IPs 104.21.66.186, 172.67.206.198, 2606:4700:3033::6815:42ba, 2606:4700:3035::ac43:cec6
Response IP 104.21.66.186
Found Yes
Hash 8a76a569608cb48f7a42804a15b9fb8aae9513aa798f1dcfd355865d09d541e7
SimHash 443fc4e3ef9b

Groups

petalbot
aspiegelbot
ahrefsbot
semrushbot
dotbot
mauibot
mj12bot
yandexbot
yandexcalendar
mail.ru_bot
blexbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /threads/*/reply

*

Rule Path
Disallow /whats-new/
Disallow /account/
Disallow /attachments/
Disallow /goto/
Disallow /posts/
Disallow /login/
Disallow /search/
Disallow /admin.php
Allow /

Other Records

Field Value
crawl-delay 5