jamesbrine.com.au
robots.txt

Robots Exclusion Standard data for jamesbrine.com.au

Resource Scan

Scan Details

Site Domain jamesbrine.com.au
Base Domain jamesbrine.com.au
Scan Status Ok
Last Scan2024-06-25T07:08:36+00:00
Next Scan 2024-07-02T07:08:36+00:00

Last Scan

Scanned2024-06-25T07:08:36+00:00
URL https://jamesbrine.com.au/robots.txt
Domain IPs 104.21.6.242, 172.67.135.125, 2606:4700:3036::6815:6f2, 2606:4700:3037::ac43:877d
Response IP 172.67.135.125
Found Yes
Hash 163c679db43e03d84e9d279a3e2ce73d6c7b022110974cc530ac5ac4793333d0
SimHash 631cc472c619

Groups

dotbot
mj12bot
blexbot
petalbot
semrushbot
ahrefsbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://jamesbrine.com.au/sitemap.xml