tunesien.ahk.de
robots.txt

Robots Exclusion Standard data for tunesien.ahk.de

Resource Scan

Scan Details

Site Domain tunesien.ahk.de
Base Domain ahk.de
Scan Status Ok
Last Scan2025-05-06T05:14:46+00:00
Next Scan 2025-06-05T05:14:46+00:00

Last Scan

Scanned2025-05-06T05:14:46+00:00
URL https://tunesien.ahk.de/robots.txt
Domain IPs 20.52.99.116
Response IP 20.52.99.116
Found Yes
Hash 5b700d6b5611df3232a17d2d31e181df6f6faf909cddfa572d7b51819d3cb53d
SimHash 21281bd657f9

Groups

*

Rule Path Comment
Allow / -
Allow /typo3conf/ext/ -
Allow /typo3temp/ -
Disallow /t3lib/ -
Disallow /typo3/ -
Disallow /typo3conf/ -
Disallow /*?id=* non-realurl URLs
Disallow /*cHash no cHash
Disallow /*tx_powermail_pi1 no powermail thanks pages
Disallow /*tx_form_formframework no forms
Disallow /*tx_solr no solr

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://tunesien.ahk.de/sitemap.xml

Comments

  • folders
  • parameters
  • sitemapHost: https://tunesien.ahk.de