costadenoticias.com.ar
robots.txt
Robots Exclusion Standard data for costadenoticias.com.ar
Resource Scan
Scan Details
Site Domain | costadenoticias.com.ar |
Base Domain | costadenoticias.com.ar |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-07-07T20:10:14+00:00 |
Next Scan | 2024-10-05T20:10:14+00:00 |
Last Successful Scan
Scanned | 2022-03-04T05:31:20+00:00 |
URL | https://costadenoticias.com.ar/robots.txt |
Redirect | https://costadenoticias.com/robots.txt |
Redirect Domain | costadenoticias.com |
Redirect Base | costadenoticias.com |
Response IP | 173.236.145.215 |
Found | Yes |
Hash | 9f92426709aa3b37c9a676e61c5b40e895387df503d2f962cee159997df9b926 |
SimHash | 2178cc9107a0 |
Groups
*
Rule | Path |
---|---|
Disallow | /?blackhole |
googlebot
Rule | Path |
---|---|
Allow | / |
Allow | /wp-admin/admin-ajax.php |
Disallow | /wp-admin/ |
Disallow | /gracias/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
msnbot
Rule | Path |
---|---|
Disallow | /category/*.xml$ |
Disallow | /plugin/ |
Disallow | /embed/ |
Disallow | /_comments/ |
Disallow | /bookmarks/ |
Disallow | /drafts/ |
Other Records
Field | Value |
---|---|
crawl-delay | 120 |
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /gracias/ |
Disallow | /_ga/ |
Disallow | /static/ |
Disallow | /dashboard/ |
Disallow | /plugin/ |
Disallow | /api/ |
Disallow | /embed/ |
Disallow | /_comments/ |
Disallow | /bookmarks/ |
Disallow | /drafts/ |
Disallow | /bpage-preview/ |
Disallow | /cms_preview_ui/ |
Disallow | /cms_preview_ui_static/ |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Warnings
- `noindex` is not a known field.