cleantec.eu
robots.txt

Robots Exclusion Standard data for cleantec.eu

Resource Scan

Scan Details

Site Domain cleantec.eu
Base Domain cleantec.eu
Scan Status Ok
Last Scan2024-05-18T23:32:27+00:00
Next Scan 2024-06-17T23:32:27+00:00

Last Scan

Scanned2024-05-18T23:32:27+00:00
URL https://cleantec.eu/robots.txt
Redirect https://www.cleantec.eu/robots.txt
Redirect Domain www.cleantec.eu
Redirect Base cleantec.eu
Domain IPs 13.53.251.71
Redirect IPs 108.156.133.113, 108.156.133.44, 108.156.133.59, 108.156.133.7
Response IP 108.156.133.7
Found Yes
Hash 69bcba2c81467dcc608d566b1da3070a360b302e4e08b3866e50ce79c3500c66
SimHash 4c7ddcb08211

Groups

*

Rule Path
Disallow /index.php/admin
Disallow /index.php/administrator
Disallow /login/
Disallow /admin/
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wordpress/login/
Disallow /wordpress/wp-login.php
Disallow /index/user
Disallow /user/
Disallow /?q=user
Disallow /?q=user%2Flogin
Disallow /administrator/

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

googlebot

Rule Path
Disallow /nogooglebot/

*

Rule Path
Allow /

Other Records

Field Value
sitemap /sitemap.xml