deine-womowelt.de
robots.txt

Robots Exclusion Standard data for deine-womowelt.de

Resource Scan

Scan Details

Site Domain deine-womowelt.de
Base Domain deine-womowelt.de
Scan Status Ok
Last Scan2024-11-02T11:55:24+00:00
Next Scan 2024-11-09T11:55:24+00:00

Last Scan

Scanned2024-11-02T11:55:24+00:00
URL http://deine-womowelt.de/robots.txt
Redirect https://www.dhd24.com/robots.txt
Redirect Domain www.dhd24.com
Redirect Base dhd24.com
Domain IPs 18.185.183.62, 18.195.114.185
Redirect IPs 18.66.147.104, 18.66.147.40, 18.66.147.66, 18.66.147.91
Response IP 18.66.147.66
Found Yes
Hash 560bc897ae11a21404da60abc7c7595ebd37d8d7d974b99b5d9bbfe5a0e00bf7
SimHash 2940c3d3d7b5

Groups

*

Rule Path
Allow /ads.txt
Disallow /

googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
mediapartners-google
mediapartners (googlebot)
adsbot-google
feedfetcher-google
ia_archiver
bingbot
heritrix
msnbot
slurp
gumgum
teoma
ebay relevance ad crawler
ebay relevance ad crawler powered by contentdetection (www.mindup.de)
browsershots
twitterbot
termlabs
ahrefssiteaudit

Rule Path
Allow /
Disallow /anzeigenlesen_alt/
Disallow /aza/
Disallow /anzeige_aufgeben/
Disallow /booking/
Disallow /extra/trap/trap.php
Disallow /feed/
Disallow /js_menu/
Disallow /recherche_inkasso/
Disallow /tracking/
Disallow /ajax/

grapeshot

Rule Path
Disallow

Comments

  • robots.txt fuer www.dhd24.com
  • [siehe http://selfhtml.teamone.de/diverses/robots.htm]
  • Allgemein
  • bestimmte Bots freigeben