Log In Sign Up

emmiegray.de
robots.txt

Robots Exclusion Standard data for emmiegray.de

Resource Scan

Scan Details

Site Domain emmiegray.de
Base Domain emmiegray.de
Scan Status Ok
Last Scan2025-10-05T02:14:44+00:00
Next Scan 2025-11-04T02:14:44+00:00

Last Scan

Scanned2025-10-05T02:14:44+00:00
URL https://emmiegray.de/robots.txt
Domain IPs 195.201.151.220
Response IP 195.201.151.220
Found Yes
Hash 808bf34423d4798f48610a3642b0511f56df04ab10b8dd7fb875bfeae85cebc1
SimHash 12564ce2faca

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

siteanalyzerbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

dataforseo

Rule Path
Disallow /

moz

Rule Path
Disallow /

majestic

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

spbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

kaloogabot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /
Back to top

Comments

  • Block aggressive and marketing bots
  • Additional marketing/crawling bots
Back to top