andreroberti.com.br
robots.txt

Robots Exclusion Standard data for andreroberti.com.br

Resource Scan

Scan Details

Site Domain andreroberti.com.br
Base Domain andreroberti.com.br
Scan Status Ok
Last Scan4/12/2025, 7:13:28 AM
Next Scan 5/12/2025, 7:13:28 AM

Last Scan

Scanned4/12/2025, 7:13:28 AM
URL https://andreroberti.com.br/robots.txt
Domain IPs 104.21.68.139, 172.67.195.238, 2606:4700:3030::6815:448b, 2606:4700:3035::ac43:c3ee
Response IP 172.67.195.238
Found Yes
Hash da4ef6e9ae7e0c29d398f62020ec702e80f4e2fad43bfea95eb034205fa53204
SimHash 4708d0d64237

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://andreroberti.com.br/index.php/sitemap.xml