Log In Sign Up

hildesheimer-allgemeine.de
robots.txt

Robots Exclusion Standard data for hildesheimer-allgemeine.de

Resource Scan

Scan Details

Site Domain hildesheimer-allgemeine.de
Base Domain hildesheimer-allgemeine.de
Scan Status Ok
Last Scan2024-06-11T23:04:16+00:00
Next Scan 2024-06-18T23:04:16+00:00

Last Scan

Scanned2024-06-11T23:04:16+00:00
URL https://hildesheimer-allgemeine.de/robots.txt
Redirect https://www.hildesheimer-allgemeine.de/robots.txt
Redirect Domain www.hildesheimer-allgemeine.de
Redirect Base hildesheimer-allgemeine.de
Domain IPs 35.242.229.239, 35.246.184.45, 35.246.248.138
Redirect IPs 151.101.130.216, 151.101.194.216, 151.101.2.216, 151.101.66.216
Response IP 151.101.66.216
Found Yes
Hash 178af7af87b23c998852164a13d64c2ad457f43bb147966936fb811e744c35a7
SimHash b2261f58cbf3

Groups

backlink-check.de

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended{*}

Rule Path
Disallow /%7B*%7D

gptbot

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

openbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

searchpreview

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seodat

Rule Path
Disallow /

seoengbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

url control

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

xovi

Rule Path
Disallow /

*

Rule Path
Allow /fileadmin/templates/*.css
Allow /fileadmin/templates/*.js
Allow /fileadmin/templates/*.jpg
Allow /fileadmin/templates/*.png
Allow /fileadmin/templates/*.gif
Disallow /fileadmin/templates/
Disallow /t3lib/
Disallow /typo3/
Disallow /typo3_src/
Allow /typo3conf/*.css
Allow /typo3conf/*.js
Allow /typo3conf/*.jpg
Allow /typo3conf/*.png
Disallow /typo3conf/
Disallow /*.rss$
Disallow /suche.html
Disallow /newsletter-services/newsletter.html
Disallow /korrekturvorschlag.html*
Back to top

Other Records

Field Value
sitemap /sitemap.xml
Back to top

Comments

  • www.robotstxt.org/
  • Legal notice: www.hildesheimer-allgemeine.de expressly reserves the right to use its content for commercial text and data mining (ยง 44b UrhG).
  • The use of robots or other automated means to access www.hildesheimer-allgemeine.de or collect or mine data without the express permission of www.hildesheimer-allgemeine.de is strictly prohibited.
  • If you would like to apply for permission to crawl www.hildesheimer-allgemeine.de, collect or use data, please contact info(at)hildesheimer-allgemeine.de
  • Allow crawling of some content
Back to top