costadenoticias.com.ar
robots.txt

Robots Exclusion Standard data for costadenoticias.com.ar

Resource Scan

Scan Details

Site Domain costadenoticias.com.ar
Base Domain costadenoticias.com.ar
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-07T20:10:14+00:00
Next Scan 2024-10-05T20:10:14+00:00

Last Successful Scan

Scanned2022-03-04T05:31:20+00:00
URL https://costadenoticias.com.ar/robots.txt
Redirect https://costadenoticias.com/robots.txt
Redirect Domain costadenoticias.com
Redirect Base costadenoticias.com
Response IP 173.236.145.215
Found Yes
Hash 9f92426709aa3b37c9a676e61c5b40e895387df503d2f962cee159997df9b926
SimHash 2178cc9107a0

Groups

*

Rule Path
Disallow /?blackhole

googlebot

Rule Path
Allow /
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /gracias/

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /category/*.xml$
Disallow /plugin/
Disallow /embed/
Disallow /_comments/
Disallow /bookmarks/
Disallow /drafts/

Other Records

Field Value
crawl-delay 120

*

Rule Path
Disallow /wp-admin/
Disallow /gracias/
Disallow /_ga/
Disallow /static/
Disallow /dashboard/
Disallow /plugin/
Disallow /api/
Disallow /embed/
Disallow /_comments/
Disallow /bookmarks/
Disallow /drafts/
Disallow /bpage-preview/
Disallow /cms_preview_ui/
Disallow /cms_preview_ui_static/

discobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

yacybot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Warnings

  • `noindex` is not a known field.