ersatzteilcheck24.de
robots.txt

Robots Exclusion Standard data for ersatzteilcheck24.de

Resource Scan

Scan Details

Site Domain ersatzteilcheck24.de
Base Domain ersatzteilcheck24.de
Scan Status Ok
Last Scan2024-10-30T02:00:58+00:00
Next Scan 2024-11-29T02:00:58+00:00

Last Scan

Scanned2024-10-30T02:00:58+00:00
URL https://ersatzteilcheck24.de/robots.txt
Redirect https://www.hgt24.de/robots.txt
Redirect Domain www.hgt24.de
Redirect Base hgt24.de
Domain IPs 185.28.158.161
Redirect IPs 185.28.158.161
Response IP 185.28.158.161
Found Yes
Hash cba6c54ee8768d44d9459f95fdf3b42406a266808227903e6843fddaf0d73549
SimHash 44d14fb14396

Groups

*

Rule Path
Allow /images/
Disallow /tst/
Allow /shop/images/
Disallow /shad/
Disallow /cgi-bin/
Disallow /kontakt.php
Disallow /shop/kontakt.php

googlebot

Rule Path
Allow /images
Allow /
Allow /shop/
Allow /shop/images/medium/
Allow /shop/images/small/

googlebot-image

Rule Path
Allow /images/
Allow /
Allow /shop/images/
Allow /shop/images/medium/
Allow /shop/images/small/

twengabot-2.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

twengabot-2.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

twengabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 8

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 8

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 8

sistrix

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmedia

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexcatalog

Rule Path
Disallow /

yadirectfetcher

Rule Path
Disallow /

yandexblogs

Rule Path
Disallow /

yandexnews

Rule Path
Disallow /

yandexpagechecker

Rule Path
Disallow /

yandexmetrika

Rule Path
Disallow /

yandexmarket

Rule Path
Disallow /

yandexcalendar

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Comments

  • mail webmaster@hausgeraetetechnik.de for further questions
  • Crawl-delay: 8
  • temporarily, nothing changes anyway
  • Disallow: /
  • chinesische suchmaschine

Warnings

  • 2 invalid lines.