Log In Sign Up

amarley.de
robots.txt

Robots Exclusion Standard data for amarley.de

Resource Scan

Scan Details

Site Domain amarley.de
Base Domain amarley.de
Scan Status Ok
Last Scan2024-11-17T10:37:48+00:00
Next Scan 2024-12-17T10:37:48+00:00

Last Scan

Scanned2024-11-17T10:37:48+00:00
URL https://amarley.de/robots.txt
Redirect https://www.amarley.de/robots.txt/
Redirect Domain www.amarley.de
Redirect Base amarley.de
Domain IPs 104.21.14.48, 172.67.157.199, 2606:4700:3034::6815:e30, 2606:4700:3035::ac43:9dc7
Redirect IPs 104.21.14.48, 172.67.157.199, 2606:4700:3034::6815:e30, 2606:4700:3035::ac43:9dc7
Response IP 104.21.14.48
Found Yes
Hash 7e4e0154eb827b6e33f61634579dafc28aada8e3b1a17ca83a9380ac1532e7b9
SimHash 9b115c616f8c

Groups

*

Rule Path
Disallow /customer/*
Disallow /checkout/*
Disallow /sales/*
Disallow /catalogsearch/result/*
Disallow *ajax*
Disallow /directory/currency/switch/currency/*
Disallow *SID*

baiduspider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

kauaibot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

spbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

semanticbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

linespider

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

snapchat

Rule Path
Disallow /

adstxtcrawlertp

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

expo9

Rule Path
Disallow /

archiver

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

inetdex-bot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

cortex

Rule Path
Disallow /

dalvik

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

trident

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.amarley.de/gz/sitemap.xml
Back to top