manualslib.de
robots.txt

Robots Exclusion Standard data for manualslib.de

Resource Scan

Scan Details

Site Domain manualslib.de
Base Domain manualslib.de
Scan Status Ok
Last Scan2024-11-13T22:16:29+00:00
Next Scan 2024-11-20T22:16:29+00:00

Last Scan

Scanned2024-11-13T22:16:29+00:00
URL https://manualslib.de/robots.txt
Redirect https://www.manualslib.de/robots.txt
Redirect Domain www.manualslib.de
Redirect Base manualslib.de
Domain IPs 88.208.52.135
Redirect IPs 88.208.52.135
Response IP 88.208.52.135
Found Yes
Hash 08afb428422363d715affb81a346e66feb271d12f9dfb15f537dc9fa7e4b133f
SimHash 07c0db40eb10

Groups

mediapartners-google

Rule Path
Allow /

*

Rule Path
Disallow /system/action/
Disallow /cron/action/
Disallow /adminAbuse/
Disallow /daemon/
Disallow /editBanners/
Disallow /editProductBanners/
Disallow /facebookLogin/
Disallow /googleLogin/
Disallow /fulltext/
Disallow /printPage/
Disallow /settings/
Disallow /stat/
Disallow /temp/
Disallow /upload/
Disallow /uploads/
Disallow /download/
Disallow *?mode=
Disallow /auth/
Disallow *code.php
Disallow /ajax/action/counter/
Disallow /user/
Disallow /tests/
Disallow /console/
Disallow *500.php
Allow /

baiduspider

Rule Path
Disallow /

addthis.com robot tech.support@clearspring.com

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

addthis.com

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

criteobot/0.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

blexbot

Rule Path
Disallow /

Comments

  • Baiduspider
  • Added by PTN