tradefarmmachinery.com.au
robots.txt

Robots Exclusion Standard data for tradefarmmachinery.com.au

Resource Scan

Scan Details

Site Domain tradefarmmachinery.com.au
Base Domain tradefarmmachinery.com.au
Scan Status Ok
Last Scan2024-09-20T17:27:05+00:00
Next Scan 2024-09-27T17:27:05+00:00

Last Scan

Scanned2024-09-20T17:27:05+00:00
URL https://tradefarmmachinery.com.au/robots.txt
Redirect https://www.tradefarmmachinery.com.au:443/robots.txt
Redirect Domain www.tradefarmmachinery.com.au
Redirect Base tradefarmmachinery.com.au
Domain IPs 13.35.18.13, 13.35.18.35, 13.35.18.78, 13.35.18.83
Redirect IPs 13.35.18.13, 13.35.18.35, 13.35.18.78, 13.35.18.83
Response IP 13.35.18.13
Found Yes
Hash f51bde19b93a7be08b078f198da94429300872503422809324897986bc38add0
SimHash 6f09d44443b1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.tradefarmmachinery.com.au/sitemap.xml