busch-jaeger.at
robots.txt

Robots Exclusion Standard data for busch-jaeger.at

Resource Scan

Scan Details

Site Domain busch-jaeger.at
Base Domain busch-jaeger.at
Scan Status Ok
Last Scan2024-09-13T13:03:00+00:00
Next Scan 2024-10-13T13:03:00+00:00

Last Scan

Scanned2024-09-13T13:03:00+00:00
URL https://busch-jaeger.at/robots.txt
Redirect https://www.busch-jaeger.at/robots.txt
Redirect Domain www.busch-jaeger.at
Redirect Base busch-jaeger.at
Domain IPs 18.156.180.252
Redirect IPs 96.17.96.31, 96.17.96.7
Response IP 23.44.4.186
Found Yes
Hash eb80775459673f4daa053ad95cd7a7e662a6b603f0569534d9cc14c3e9e19940
SimHash 0e0149044b42

Groups

*

Rule Path
Disallow /*?id=*
Disallow /*%26id%3D*
Disallow /*?L=0*
Disallow /*%26L%3D0*
Disallow /*?tx_solr*
Disallow /*%26tx_solr*
Disallow /*/Private/*
Disallow /*/Configuration/*
Disallow /typo3temp/*
Disallow /media/bje/*
Disallow /fileadmin/ing*
Allow /typo3temp/*.css
Allow /typo3temp/*.css.*.gzip
Allow /typo3temp/*.js
Allow /typo3temp/*.js.*.gzip
Allow /typo3temp/*.jpg
Allow /typo3temp/*.gif
Allow /typo3temp/*.png
Disallow *.sql
Disallow *.sql.gz

Other Records

Field Value
crawl-delay 10