castor.es
robots.txt
Robots Exclusion Standard data for castor.es
Resource Scan
Scan Details
Site Domain | castor.es |
Base Domain | castor.es |
Scan Status | Ok |
Last Scan | 2024-10-02T01:37:34+00:00 |
Next Scan | 2024-10-09T01:37:34+00:00 |
Last Scan
Scanned | 2024-10-02T01:37:34+00:00 |
URL | https://castor.es/robots.txt |
Redirect | https://www.castor.es/robots.txt |
Redirect Domain | www.castor.es |
Redirect Base | castor.es |
Domain IPs | 213.186.33.2 |
Redirect IPs | 213.186.33.2 |
Response IP | 213.186.33.2 |
Found | Yes |
Hash | 5a2689304c6bda9b85f151c4d4aedd6bcaf45a4a31e51b32e606b581926a7dad |
SimHash | ec0d65900bd2 |
Groups
*
Rule | Path |
---|---|
Disallow | /WI/ |
Disallow | /quota.cgi |
Disallow | /_vti_cnf/ |
Disallow | /tutoriales/ |
Disallow | /france/ |
Disallow | /paypal_ok.html |
Disallow | /compras-madera-correcto.html |
Disallow | /compras-madera-cancelado.html |
Disallow | /condiciones-de-uso.html |
Disallow | /contacto.html |
Disallow | /politica-de-privacidad.html |
Disallow | /cookies.html |
Disallow | /foto/ |
Disallow | /chat/ |
Disallow | /info-fresadora-CNC/ |
Disallow | /cufon/ |
Disallow | /css/ |
Disallow | /test.html |
Disallow | /test1.html |
Disallow | /test.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.castor.es/sitemap.xml |