ceresitshop-msk.ru
robots.txt

Robots Exclusion Standard data for ceresitshop-msk.ru

Resource Scan

Scan Details

Site Domain ceresitshop-msk.ru
Base Domain ceresitshop-msk.ru
Scan Status Ok
Last Scan2024-11-07T19:17:14+00:00
Next Scan 2024-12-07T19:17:14+00:00

Last Scan

Scanned2024-11-07T19:17:14+00:00
URL https://ceresitshop-msk.ru/robots.txt
Domain IPs 185.125.59.60
Response IP 185.125.59.60
Found Yes
Hash 29a4a79cf28c6912eb2033d2fca764f463a5feabb8eb1054c82b23b416efd218
SimHash ecf9dff06a0a

Groups

*

Rule Path
Disallow /files/
Disallow /product-prop.json
Disallow /coloring
Disallow /cart
Disallow /login
Disallow /cabinet
Disallow /policy
Disallow /soglashenie
Disallow /send-me
Disallow /thanks
Disallow /guide
Disallow /*?
Disallow /assets/user

ltx71

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

idbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baidu

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ceresitshop-msk.ru/sitemap.xml