Log In Sign Up

cafesoft.ru
robots.txt

Robots Exclusion Standard data for cafesoft.ru

Resource Scan

Scan Details

Site Domain cafesoft.ru
Base Domain cafesoft.ru
Scan Status Ok
Last Scan2024-10-13T15:44:12+00:00
Next Scan 2024-11-12T15:44:12+00:00

Last Scan

Scanned2024-10-13T15:44:12+00:00
URL http://www.cafesoft.ru/robots.txt
Domain IPs 62.122.170.171
Response IP 62.122.170.171
Found Yes
Hash c32f403383c5f9d7027338dfb277e05d8e11cd98db8c36f11a80deb443fded2d
SimHash 501cc0a0eb08

Groups

*
baiduspider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

bingbot/2.0

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

checkmarknetwork/1.0 (+https://www.checkmarknetwork.com/spider.html)

Rule Path
Disallow /

dotbot/1.2

Rule Path
Disallow /
Back to top