Log In Sign Up

radonline.de
robots.txt

Robots Exclusion Standard data for radonline.de

Resource Scan

Scan Details

Site Domain radonline.de
Base Domain radonline.de
Scan Status Ok
Last Scan2024-09-26T10:55:39+00:00
Next Scan 2024-10-26T10:55:39+00:00

Last Scan

Scanned2024-09-26T10:55:39+00:00
URL https://radonline.de/robots.txt
Redirect https://www.radonline.de/robots.txt
Redirect Domain www.radonline.de
Redirect Base radonline.de
Domain IPs 194.6.211.131, 2a00:f48:1008::211:131:10
Redirect IPs 194.6.211.131, 2a00:f48:1008::211:131:10
Response IP 194.6.211.131
Found Yes
Hash 240ba5005579b03c787cac8bb2b7eb75c2b7328af24cdabaa9fa945c8c6e3969
SimHash 1814df75720b

Groups

googlebot-image

Rule Path
Disallow
Disallow /widgets/menu
Disallow /navigation

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

twengabot-2.0

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.radonline.de/sitemap.xml
Back to top

Comments

  • Google Image Crawler Setup
  • Website Sitemap
  • Crawlers Setup
  • User-agent: *
  • Crawl-delay: 10
  • Baiduspider
  • Yandex
Back to top