tribunadonorte.com.br
robots.txt
Robots Exclusion Standard data for tribunadonorte.com.br
Resource Scan
Scan Details
Site Domain | tribunadonorte.com.br |
Base Domain | tribunadonorte.com.br |
Scan Status | Ok |
Last Scan | 2024-05-13T08:10:26+00:00 |
Next Scan | 2024-05-20T08:10:26+00:00 |
Last Scan
Scanned | 2024-05-13T08:10:26+00:00 |
URL | https://tribunadonorte.com.br/robots.txt |
Domain IPs | 162.159.136.54, 162.159.137.54 |
Response IP | 162.159.137.54 |
Found | Yes |
Hash | 64370a24b2d0811a7db2037319f9f8ce36404d030039934bf5862bd11e254057 |
SimHash | 71a0d8438092 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /search/ |
Disallow | /go/ |
Disallow | */?bsf= |
Disallow | /changelog/*/feed/ |
Disallow | /feed/atom/ |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
Other Records
Field | Value |
---|---|
sitemap | http://portal.tribunadonorte.com.br/sitemap.xml |
sitemap | http://portal.tribunadonorte.com.br/sitemap.rss |