consistec.de
robots.txt

Robots Exclusion Standard data for consistec.de

Resource Scan

Scan Details

Site Domain consistec.de
Base Domain consistec.de
Scan Status Ok
Last Scan2024-11-11T20:12:50+00:00
Next Scan 2024-12-11T20:12:50+00:00

Last Scan

Scanned2024-11-11T20:12:50+00:00
URL https://consistec.de/robots.txt
Redirect https://www.consistec.de/robots.txt
Redirect Domain www.consistec.de
Redirect Base consistec.de
Domain IPs 89.244.168.180
Redirect IPs 89.244.168.180
Response IP 89.244.168.180
Found Yes
Hash 1d4a3fb2c3eb2b8b74c01f8da8b3123677a6fa94d00e2ae8a2315581810275e8
SimHash 299e8b28d350

Groups

*

Rule Path
Disallow /typo3/typo3/
Disallow /typo3/typo3_src/
Disallow /typo3/typo3conf/
Disallow /typo3/typo3temp/
Disallow /typo3/t3lib/
Disallow /typo3/tslib/

surveybot

Rule Path
Disallow /

websitewiki

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

jakarta commons-httpclient

Rule Path
Disallow /

aboutusbot

Rule Path
Disallow /

semager

Rule Path
Disallow /

linguee

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

gonzo

Rule Path
Disallow /

zeusbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /