uni-on.es
robots.txt
Robots Exclusion Standard data for uni-on.es
Resource Scan
Scan Details
Site Domain | uni-on.es |
Base Domain | uni-on.es |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2025-05-04T06:30:46+00:00 |
Next Scan | 2025-08-02T06:30:46+00:00 |
Last Successful Scan
Scanned | 2024-01-11T06:21:52+00:00 |
URL | https://uni-on.es/robots.txt |
Domain IPs | 104.21.74.171, 172.67.160.83, 2606:4700:3032::6815:4aab, 2606:4700:3033::ac43:a053 |
Response IP | 104.21.74.171 |
Found | Yes |
Hash | e14999f2bc6efd4b501fa0198ccee0b21466f23a1217d4a1efa3c84f74c26b1d |
SimHash | e8dc580acc45 |
Groups
*
Rule | Path |
---|---|
Allow | /wp-content/uploads/* |
Allow | /wp-content/*.js |
Allow | /wp-content/*.css |
Allow | /wp-includes/*.js |
Allow | /wp-includes/*.css |
Disallow | /cgi-bin |
Disallow | /wp-content/plugins/ |
Disallow | /wp-content/themes/ |
Disallow | /wp-includes/ |
Disallow | /*/attachment/ |
Disallow | /tag/*/page/ |
Disallow | /tag/*/feed/ |
Disallow | /page/ |
Disallow | /comments/ |
Disallow | /xmlrpc.php |
Disallow | /?attachment_id* |
Disallow | /*? |
*
Rule | Path |
---|---|
Disallow | /?s= |
Disallow | /search |
*
Rule | Path |
---|---|
Disallow | /trackback |
Disallow | /*trackback |
Disallow | /*trackback* |
Disallow | /*/trackback |
*
Rule | Path |
---|---|
Allow | /feed/$ |
Disallow | /feed/ |
Disallow | /comments/feed/ |
Disallow | /*/feed/$ |
Disallow | /*/feed/rss/$ |
Disallow | /*/trackback/$ |
Disallow | /*/*/feed/$ |
Disallow | /*/*/feed/rss/$ |
Disallow | /*/*/trackback/$ |
Disallow | /*/*/*/feed/$ |
Disallow | /*/*/*/feed/rss/$ |
Disallow | /*/*/*/trackback/$ |
Other Records
Field | Value |
---|---|
sitemap | https://uni-on.es/sitemap_index.xml |
Comments