dvag.de
robots.txt

Robots Exclusion Standard data for dvag.de

Resource Scan

Scan Details

Site Domain dvag.de
Base Domain dvag.de
Scan Status Ok
Last Scan2025-02-17T11:04:47+00:00
Next Scan 2025-03-19T11:04:47+00:00

Last Scan

Scanned2025-02-17T11:04:47+00:00
URL https://dvag.de/robots.txt
Redirect https://www.dvag.de/robots.txt
Redirect Domain www.dvag.de
Redirect Base dvag.de
Domain IPs 84.201.22.129
Redirect IPs 84.201.22.129
Response IP 84.201.22.129
Found Yes
Hash aa64f861468ed65f9a01c8da6f981fefd5b1a33705e758448bcdc73379a49c43
SimHash dc3cd962e982

Groups

ahrefsbot
amazonbot
applebot
blexbot
claudebot
claude-web
dataforseobot
pandalytics/1.0
pandalytics
domainsbot
trustoo

Rule Path
Disallow /

*

Rule Path
Disallow *.lightbox*
Disallow /maria.muster/
Disallow /Maria.Muster/
Disallow /klaus.schultze.
Disallow /Klaus.Schultze.
Disallow /servlets/search
Disallow *search_result*
Disallow /etc/clientlibs/dvag/*/js
Disallow /servlets/vbfinder

Other Records

Field Value
sitemap https://www.dvag.de/content/dvag-ug/tenants/dvag/sitemap-index.xml

Comments

  • disable bots
  • disable pages
  • Sitemap Path