staedtler.com
robots.txt

Robots Exclusion Standard data for staedtler.com

Resource Scan

Scan Details

Site Domain staedtler.com
Base Domain staedtler.com
Scan Status Ok
Last Scan2024-11-14T03:51:16+00:00
Next Scan 2024-11-28T03:51:16+00:00

Last Scan

Scanned2024-11-14T03:51:16+00:00
URL https://staedtler.com/robots.txt
Redirect https://www.staedtler.com/robots.txt
Redirect Domain www.staedtler.com
Redirect Base staedtler.com
Domain IPs 185.191.120.27
Redirect IPs 185.191.120.27
Response IP 185.191.120.27
Found Yes
Hash 9a2774a401a5a99cb6c2236a24e39862f96e403501fea237a4e48d828833a0e5
SimHash d0964162eab2

Groups

amazonproductdiscoverybot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

wirereaderbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

*

Rule Path
Disallow /fileadmin/pdf/Hobby-Creative-Katalog-2016/files/
Disallow /fileadmin/tradeguide/
Disallow /fileadmin/tradeguide2023/
Disallow /fileadmin/tradeguide2024/
Disallow /fileadmin/tradeguide2024_de/
Disallow /fileadmin/refill/
Disallow *tx_powermail_pi1*
Disallow /*?*id*
Disallow /*?*cHash*
Allow /