ceresitshop.ru
robots.txt

Robots Exclusion Standard data for ceresitshop.ru

Resource Scan

Scan Details

Site Domain ceresitshop.ru
Base Domain ceresitshop.ru
Scan Status Ok
Last Scan2024-11-07T12:34:13+00:00
Next Scan 2024-12-07T12:34:13+00:00

Last Scan

Scanned2024-11-07T12:34:13+00:00
URL https://ceresitshop.ru/robots.txt
Domain IPs 185.125.59.60
Response IP 185.125.59.60
Found Yes
Hash 824ce14b84206a63a7c2e55a3d13c3ee119f64cf17dd8d17f1d6b3d818907518
SimHash 2e388f714a0b

Groups

*

Rule Path
Disallow /files/
Disallow /product-prop.json
Disallow /coloring
Disallow /colorceresit
Disallow /cart
Disallow /cabinet
Disallow /policy
Disallow /guide
Disallow /send-me
Disallow /*?*=
Disallow /*%26
Disallow /?
Disallow /index.php$
Disallow /index$
Disallow /search
Disallow /tg.php
Disallow /certificates

ltx71

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

idbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baidu

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ceresitshop.ru/sitemap.xml
sitemap https://ceresitshop.ru/sitemap-colors.xml