geschenke24.de
robots.txt

Robots Exclusion Standard data for geschenke24.de

Resource Scan

Scan Details

Site Domain geschenke24.de
Base Domain geschenke24.de
Scan Status Ok
Last Scan2024-05-21T20:13:34+00:00
Next Scan 2024-06-20T20:13:34+00:00

Last Scan

Scanned2024-05-21T20:13:34+00:00
URL https://geschenke24.de/robots.txt
Redirect https://www.geschenke24.de/robots.txt
Redirect Domain www.geschenke24.de
Redirect Base geschenke24.de
Domain IPs 104.26.14.118, 104.26.15.118, 172.67.73.137, 2606:4700:20::681a:e76, 2606:4700:20::681a:f76, 2606:4700:20::ac43:4989
Redirect IPs 104.26.14.118, 104.26.15.118, 172.67.73.137, 2606:4700:20::681a:e76, 2606:4700:20::681a:f76, 2606:4700:20::ac43:4989
Response IP 172.67.73.137
Found Yes
Hash 5384c994ecb5cbf50cb5c07c48ab9f31009fdc529441206cc6a1d51b1c69dc87
SimHash 590d00b2ce9a

Groups

ahrefsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sistrix optimizer

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow */?
Disallow */account/
Disallow */checkout/
Disallow */customization/
Disallow */navigation/
Disallow */bundles/

Other Records

Field Value
sitemap /sitemap.xml