Log In Sign Up

buergerhefte.de
robots.txt

Robots Exclusion Standard data for buergerhefte.de

Resource Scan

Scan Details

Site Domain buergerhefte.de
Base Domain buergerhefte.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-07T17:28:05+00:00
Next Scan 2024-10-05T17:28:05+00:00

Last Successful Scan

Scanned2023-12-11T17:16:54+00:00
URL https://www.buergerhefte.de/robots.txt
Domain IPs 82.211.32.220
Response IP 82.211.32.220
Found Yes
Hash e01d78e0e572d487559006ff9a424dd2b7c600358e567e932d8034669190a796
SimHash 32241510ecb7

Groups

*

Rule Path
Disallow /_/tools/
Disallow /_/
Disallow /_/chat.html*
Disallow /_/ecards.html
Disallow /_/forum/
Disallow /_/tools/pdfpage.html
Disallow /_/tools/pdfpage.html*
Disallow /intern_technik/
Disallow /hos/
Disallow /_/register/
Disallow /fcms/
Disallow /epaper/
Disallow /hos_test/
Disallow /register/
Disallow /*?wt_mc=
Disallow /admin/
Disallow /*?show=*
Disallow /navre/
Disallow /dpa/
Disallow /login/
Disallow /usersuche/
Disallow /nachrichten/hos_test/
Disallow /fotos/bilddetail_hostest/
Disallow /*php3$
Disallow /*.php4*
Disallow */oms.kanews.de/*

webreaper

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.ka-news.de/sitemap-ksc-news.sitemap.xml
sitemap https://www.ka-news.de/IndexSitemap.sitemap.xml
sitemap https://www.ka-news.de/Sitemap.sitemap.xml
sitemap https://www.ka-news.de/sitemap-wirtschaft.sitemap.xml
sitemap https://www.ka-news.de/sitemap-kultur.sitemap.xml
sitemap https://www.ka-news.de/sitemap-region.sitemap.xml
Back to top

Comments

  • ID: 1
  • Disallow: /*?_FRAME=33&_FORMAT=PRINT
  • Disallow: /*?_FRAME=*
  • Disallow: /*_FRAME=33$
  • Disallow: /*_FRAME=64$
  • Legal notice: ka-news.de expressly reserves the right to use its content for commercial text and data mining (ยง 44b UrhG).
  • The use of robots or other automated means to access ka-news.de or collect or mine data without the express permission of ka-news.de is strictly prohibited.
  • OpenAI
  • Google Bard
  • Common Crawl Foundation
Back to top