Log In Sign Up

dajar.de
robots.txt

Robots Exclusion Standard data for dajar.de

Resource Scan

Scan Details

Site Domain dajar.de
Base Domain dajar.de
Scan Status Ok
Last Scan2026-01-16T10:43:52+00:00
Next Scan 2026-02-15T10:43:52+00:00

Last Scan

Scanned2026-01-16T10:43:52+00:00
URL https://dajar.de/robots.txt
Domain IPs 104.25.181.71, 104.25.182.71, 172.67.67.142, 2606:4700:20::6819:b547, 2606:4700:20::6819:b647, 2606:4700:20::ac43:438e
Response IP 104.25.182.71
Found Yes
Hash 5b41530bf6c8fc32101b83885fc7ab129a153c11a7c63ecacb8705ffc8904521
SimHash d644cc098293

Groups

*

Rule Path
Disallow /product-search/
Disallow /searchengine/
Disallow /rest/
Disallow /c/1
Disallow /c/2

*

Rule Path
Disallow /*manyfilters%3Dtrue
Disallow /*limit%3D
Disallow /*dir%3D
Disallow /*order%3D

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

jobboersebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

adscanner

Rule Path
Disallow /
Back to top

Comments

  • .__________________________.
  • | .___________________. |==|
  • | | ................. | | |
  • | | ::[ Dear robot ]: | | |
  • | | ::::[ be nice ]:: | | |
  • | | ::::::::::::::::: | | |
  • | | ::::::::::::::::: | | |
  • | | ::::::::::::::::: | | |
  • | | ::::::::::::::::: | | ,|
  • | !___________________! |(c|
  • !_______________________!__!
  • / \
  • / [][][][][][][][][][][][][] \
  • / [][][][][][][][][][][][][][] \
  • ( [][][][][____________][][][][] )
  • \ ------------------------------ /
  • \______________________________/
Back to top