history.de
robots.txt

Robots Exclusion Standard data for history.de

Resource Scan

Scan Details

Site Domain history.de
Base Domain history.de
Scan Status Ok
Last Scan2024-06-30T19:46:45+00:00
Next Scan 2024-07-07T19:46:45+00:00

Last Scan

Scanned2024-06-30T19:46:45+00:00
URL https://history.de/robots.txt
Redirect https://www.history.de/robots.txt
Redirect Domain www.history.de
Redirect Base history.de
Domain IPs 2a03:2a00:1200:0:1::3950, 37.202.6.46
Redirect IPs 37.202.6.46
Response IP 37.202.6.46
Found Yes
Hash 1857ad7e4eb48da20990e407a1641608a45bf40cfeb5c916f46b406775be0c13
SimHash 250003d677f1

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path Comment
Allow / -
Disallow /typo3/ -
Disallow /typo3conf/ -
Allow /typo3conf/ext/ -
Allow /typo3temp/ -
Disallow /*?id=* non speaking URLs
Disallow /*cHash no cHash
Disallow /*tx_powermail_pi1 no powermail thanks pages
Disallow /*tx_form_formframework no forms

Other Records

Field Value
sitemap https://www.history.de/sitemap.xml

Comments

  • sitemap
  • folders
  • parameters