mrnews.com.br
robots.txt

Robots Exclusion Standard data for mrnews.com.br

Resource Scan

Scan Details

Site Domain mrnews.com.br
Base Domain mrnews.com.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-13T23:38:59+00:00
Next Scan 2024-08-12T23:38:59+00:00

Last Successful Scan

Scanned2024-04-15T22:57:03+00:00
URL https://mrnews.com.br/robots.txt
Domain IPs 104.21.5.114, 172.67.133.93, 2606:4700:3030::ac43:855d, 2606:4700:3033::6815:572
Response IP 104.21.5.114
Found Yes
Hash 4f6e7f854a23a2c6e04d731d41c140a3591521d919376df2c971a79fca5da09b
SimHash a58290002eb4

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin

Other Records

Field Value
sitemap https://mrnews.com.br/index.php/sitemap_index.xml

Comments

  • Robots.txt generated by Booter - Crwalers Manager at Thu, 26 Nov 2020 01:00:00 +0000
  • Do not modify this file, any contents will be overwritten