blickpunkt-nienburg.de
robots.txt

Robots Exclusion Standard data for blickpunkt-nienburg.de

Resource Scan

Scan Details

Site Domain blickpunkt-nienburg.de
Base Domain blickpunkt-nienburg.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-15T17:22:12+00:00
Next Scan 2024-06-14T17:22:12+00:00

Last Successful Scan

Scanned2023-12-18T17:20:59+00:00
URL https://blickpunkt-nienburg.de/robots.txt
Domain IPs 91.208.158.75
Response IP 91.208.158.75
Found Yes
Hash 832c7c5bfb203549139f0c76ee57a24b54436c3836bd3512939b40b290247fbf
SimHash 6b0112404333

Groups

*

Rule Path
Disallow /lightweight-ajax
Disallow /*?trafficsource
Disallow /suche/
Disallow /*?cmp=defrss
Disallow /test/
Disallow /bi/bootstrap/
Disallow /bi/doop/

xovi

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /test/

gptbot

Rule Path
Allow /ueber-uns/
Disallow /

ccbot

Rule Path
Allow /ueber-uns/
Disallow /

msnbot

Rule Path
Disallow /test/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.blickpunkt-nienburg.de/sitemap-index.xml
sitemap https://www.blickpunkt-nienburg.de/sitemap-image-index.xml
sitemap https://www.blickpunkt-nienburg.de/sitemap-index.xml
sitemap https://www.blickpunkt-nienburg.de/sitemap-image-index.xml
sitemap https://www.blickpunkt-nienburg.de/sitemap-index.xml
sitemap https://www.blickpunkt-nienburg.de/sitemap-image-index.xml

Comments

  • robots.txt www.blickpunkt-nienburg.de