reportermt.com.br
robots.txt

Robots Exclusion Standard data for reportermt.com.br

Resource Scan

Scan Details

Site Domain reportermt.com.br
Base Domain reportermt.com.br
Scan Status Ok
Last Scan2024-09-20T07:03:37+00:00
Next Scan 2024-09-27T07:03:37+00:00

Last Scan

Scanned2024-09-20T07:03:37+00:00
URL https://reportermt.com.br/robots.txt
Redirect https://www.reportermt.com/robots.txt
Redirect Domain www.reportermt.com
Redirect Base reportermt.com
Domain IPs 104.21.33.18, 172.67.157.152, 2606:4700:3033::6815:2112, 2606:4700:3033::ac43:9d98
Redirect IPs 104.21.60.216, 172.67.201.204, 2606:4700:3032::ac43:c9cc, 2606:4700:3034::6815:3cd8
Response IP 172.67.201.204
Found Yes
Hash 49b701a1be4401e98da673daaeb7377a89a36f8b316e8a7804cf4e84c3847e33
SimHash 6f14dc544691

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.reportermt.com/sitemaps/1/sitemap-index.xml