tophair.de
robots.txt
Robots Exclusion Standard data for tophair.de
Resource Scan
Scan Details
| Site Domain | tophair.de |
| Base Domain | tophair.de |
| Scan Status | Ok |
| Last Scan | 2024-09-10T20:01:58+00:00 |
| Next Scan | 2024-10-10T20:01:58+00:00 |
Last Scan
| Scanned | 2024-09-10T20:01:58+00:00 |
| URL | https://tophair.de/robots.txt |
| Redirect | https://www.tophair.de/robots.txt |
| Redirect Domain | www.tophair.de |
| Redirect Base | tophair.de |
| Domain IPs | 128.204.136.111 |
| Redirect IPs | 128.204.136.111 |
| Response IP | 128.204.136.111 |
| Found | Yes |
| Hash | 7beb72e57dcc88cfd1804a18ac9ec00e395db2ae87f430da059ec63a3e706842 |
| SimHash | 345482c3db77 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /typo3/ |
| Disallow | /typo3conf/ |
| Allow | /typo3conf/ext/*/Public/* |
| Disallow | /fileadmin/_temp_/ |
| Allow | /fileadmin/_processed_/ |
| Disallow | /typo3temp/ |
| Allow | /typo3temp/GB/ |
| Allow | /typo3temp/pics/ |
| Allow | /typo3temp/assets/images/* |
| Allow | /typo3temp/assets/_processed_/* |
| Allow | /typo3temp/assets/compressed/merged*.css* |
| Allow | /typo3temp/assets/compressed/merged*.css.gzip* |
| Allow | /typo3temp/assets/compressed/app*.js* |
| Allow | /typo3temp/assets/compressed/app*.js.gzip* |
| Allow | /typo3temp/assets/compressed/main*.js* |
| Allow | /typo3temp/assets/compressed/main*.js.gzip* |
| Allow | /typo3temp/assets/compressed/manifest*.js* |
| Allow | /typo3temp/assets/compressed/manifest*.js.gzip* |
| Allow | /typo3temp/assets/compressed/merged*.js* |
| Allow | /typo3temp/assets/compressed/merged*.js.gzip* |
| Allow | /typo3temp/assets/compressed/vendors*.js* |
| Allow | /typo3temp/assets/compressed/vendors*.js.gzip* |
| Disallow | /*?id=* |
| Disallow | /*cHash |
| Disallow | /*tx_form_formframework |
| Allow | /sitemap.xml?sitemap=*&cHash=* |
| Allow | /sitemap.xml?page=*&sitemap=*&cHash=* |
gptbot
backlink-check.de
backlinkcrawler
bloodhound
cydralspider
downloadexpress
extractorpro
fasterfox
gammaspider
linkextractorpro
linkwalker
meltwater
mj12bot
newsnow
node/simplecrawler
node/simplecrawler 0.7.0 (git+https://github.com/cgiffard/node-simplecrawler.git)
objectssearch
openbot
pimptrain
raven
rogerbot
searchpreview
simplecrawler
seodat
seoengbot
seokicks-robot
true_robot
url control
url_spider_pro
wapspider
webzinger
xovi
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.tophair.de/sitemap.xml |
Comments