sistel.es
robots.txt
Robots Exclusion Standard data for sistel.es
Resource Scan
Scan Details
| Site Domain | sistel.es |
| Base Domain | sistel.es |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-08-05T08:39:06+00:00 |
| Next Scan | 2025-11-03T08:39:06+00:00 |
Last Successful Scan
| Scanned | 2025-03-16T06:18:29+00:00 |
| URL | https://sistel.es/robots.txt |
| Domain IPs | 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001 |
| Response IP | 104.21.32.1 |
| Found | Yes |
| Hash | 7aabe9fed55759b558a606660228a684913990d4489b15a6f724f4ee0ccd1465 |
| SimHash | fd30ab10d5f8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp- |
| Disallow | /wp/ |
| Disallow | /? |
| Disallow | *?s= |
| Disallow | *%26s%3D |
| Disallow | /search |
| Disallow | /author/ |
| Disallow | /tag/ |
| Disallow | /category/ |
| Disallow | */embed$ |
| Disallow | */page/ |
| Disallow | */xmlrpc.php |
| Disallow | *utm*%3D |
| Disallow | *openstat%3D |
| Allow | */wp-*/*ajax*.php |
| Allow | */wp-sitemap |
| Allow | */uploads |
| Allow | */wp-*/*.js |
| Allow | */wp-*/*.css |
| Allow | */wp-*/*.png |
| Allow | */wp-*/*.jpg |
| Allow | */wp-*/*.jpeg |
| Allow | */wp-*/*.gif |
| Allow | */wp-*/*.svg |
| Allow | */wp-*/*.webp |
| Allow | */wp-*/*.swf |
| Allow | */wp-*/*.pdf |