tunesien.ahk.de
robots.txt
Robots Exclusion Standard data for tunesien.ahk.de
Resource Scan
Scan Details
Site Domain | tunesien.ahk.de |
Base Domain | ahk.de |
Scan Status | Ok |
Last Scan | 2025-05-06T05:14:46+00:00 |
Next Scan | 2025-06-05T05:14:46+00:00 |
Last Scan
Scanned | 2025-05-06T05:14:46+00:00 |
URL | https://tunesien.ahk.de/robots.txt |
Domain IPs | 20.52.99.116 |
Response IP | 20.52.99.116 |
Found | Yes |
Hash | 5b700d6b5611df3232a17d2d31e181df6f6faf909cddfa572d7b51819d3cb53d |
SimHash | 21281bd657f9 |
Groups
*
Rule | Path | Comment |
---|---|---|
Allow | / | - |
Allow | /typo3conf/ext/ | - |
Allow | /typo3temp/ | - |
Disallow | /t3lib/ | - |
Disallow | /typo3/ | - |
Disallow | /typo3conf/ | - |
Disallow | /*?id=* | non-realurl URLs |
Disallow | /*cHash | no cHash |
Disallow | /*tx_powermail_pi1 | no powermail thanks pages |
Disallow | /*tx_form_formframework | no forms |
Disallow | /*tx_solr | no solr |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://tunesien.ahk.de/sitemap.xml |
Comments