allcafe.ru
robots.txt

Robots Exclusion Standard data for allcafe.ru

Resource Scan

Scan Details

Site Domain allcafe.ru
Base Domain allcafe.ru
Scan Status Ok
Last Scan2024-11-07T03:50:06+00:00
Next Scan 2024-12-07T03:50:06+00:00

Last Scan

Scanned2024-11-07T03:50:06+00:00
URL https://allcafe.ru/robots.txt
Domain IPs 104.26.2.146, 104.26.3.146, 172.67.74.233, 2606:4700:20::681a:292, 2606:4700:20::681a:392, 2606:4700:20::ac43:4ae9
Response IP 104.26.2.146
Found Yes
Hash 9c5c9a5f5c693c9191caea377267880d00794a3593e0d55dfee324bf377660ac
SimHash 5c589b56e700

Groups

yandex

Rule Path
Disallow
Disallow /*?
Disallow /_src/
Disallow /_html/
Disallow /static/html/tmp/
Disallow /branding/
Disallow /search2/
Disallow /community/
Disallow /hotels/
Disallow /profy/
Disallow /*android-app%3A/com.google.android.googlequicksearchbox
Allow /sitemaps.xml?*
Allow /static/*

*

Rule Path
Disallow
Disallow /*?
Disallow /_src/
Disallow /_html/
Disallow /static/html/tmp/
Disallow /branding/
Disallow /search2/
Disallow /community/
Disallow /hotels/
Disallow /profy/
Allow /sitemaps.xml?*
Allow /static/*

yandexnews

Rule Path
Allow /rss/yandexnews/

dataforseobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://allcafe.ru/sitemaps.xml
sitemap https://allcafe.ru/sitemaps.xml