aceitedegirasol.es
robots.txt

Robots Exclusion Standard data for aceitedegirasol.es

Resource Scan

Scan Details

Site Domain aceitedegirasol.es
Base Domain aceitedegirasol.es
Scan Status Ok
Last Scan2025-03-31T03:39:07+00:00
Next Scan 2025-04-07T03:39:07+00:00

Last Scan

Scanned2025-03-31T03:39:07+00:00
URL http://aceitedegirasol.es/robots.txt
Redirect http://www.aceitedegirasol.es/robots.txt
Redirect Domain www.aceitedegirasol.es
Redirect Base aceitedegirasol.es
Domain IPs 185.27.134.105
Redirect IPs 185.27.134.105
Response IP 185.27.134.105
Found Yes
Hash 5dca56a364c7976c920699efb088e2b3f617457c243d3e8e397bc7d7a0d8f989
SimHash 6c505028c3e3

Groups

httrack 3.0x

Rule Path
Disallow /

psbot

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /error/