Log In Sign Up

amongushop.ru
robots.txt

Robots Exclusion Standard data for amongushop.ru

Resource Scan

Scan Details

Site Domain amongushop.ru
Base Domain amongushop.ru
Scan Status Ok
Last Scan2024-10-01T09:35:35+00:00
Next Scan 2024-10-31T09:35:35+00:00

Last Scan

Scanned2024-10-01T09:35:35+00:00
URL https://amongushop.ru/robots.txt
Domain IPs 81.90.180.144
Response IP 81.90.180.144
Found Yes
Hash 74461206f5da437c5514f0f62c17c397a78b2356ea6ec5a3985b52e75b7e95d3
SimHash 0e985942c311

Groups

googlebot

Rule Path
Allow /*.js
Allow /*.css
Disallow /*?sort=*
Disallow /status/*
Disallow /profile/*
Disallow /cart/

yandex

Rule Path
Disallow /*?sort=*
Disallow /status/*
Disallow /profile/*
Disallow /cart/

riddler

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

ccresearchbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

megaindex\.ru/2\.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

archive\.org_bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

detectify

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

boitho

Rule Path
Disallow /

psbot

Rule Path
Disallow /

uptimerobot/2.0

Rule Path
Disallow /

sogou

Rule Path
Disallow /

slurp

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top

Warnings

  • `clean-param` is not a known field.
Back to top