hensing-get-it.com
robots.txt

Robots Exclusion Standard data for hensing-get-it.com

Resource Scan

Scan Details

Site Domain hensing-get-it.com
Base Domain hensing-get-it.com
Scan Status Ok
Last Scan2025-08-07T10:18:15+00:00
Next Scan 2025-09-06T10:18:15+00:00

Last Scan

Scanned2025-08-07T10:18:15+00:00
URL https://hensing-get-it.com/robots.txt
Redirect https://www.hensing-get-it.com/robots.txt
Redirect Domain www.hensing-get-it.com
Redirect Base hensing-get-it.com
Domain IPs 185.175.196.73, 2a00:1c98:60:1100::67f0:624b
Redirect IPs 185.175.196.73, 2a00:1c98:60:1100::67f0:624b
Response IP 185.175.196.73
Found Yes
Hash efa3903669ff09b9c337118e39c2ea6d2f53bac738c9acb2cc83f1af4bb5b36d
SimHash 2464d8c387b1

Groups

baiduspider

Rule Path
Disallow /

bingbot
slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /blog/page/*

Other Records

Field Value
sitemap https://www.hensing-get-it.com/sitemap_index.xml

Comments

  • Baidu ausschliessen
  • Bing und Yahoo Bots leicht drosseln
  • Yandex stark drosseln