freestuff.com.au
robots.txt

Robots Exclusion Standard data for freestuff.com.au

Resource Scan

Scan Details

Site Domain freestuff.com.au
Base Domain freestuff.com.au
Scan Status Ok
Last Scan2024-11-12T16:51:16+00:00
Next Scan 2024-11-19T16:51:16+00:00

Last Scan

Scanned2024-11-12T16:51:16+00:00
URL https://freestuff.com.au/robots.txt
Redirect https://www.freestuff.com.au/robots.txt
Redirect Domain www.freestuff.com.au
Redirect Base freestuff.com.au
Domain IPs 104.26.10.152, 104.26.11.152, 172.67.73.72, 2606:4700:20::681a:a98, 2606:4700:20::681a:b98, 2606:4700:20::ac43:4948
Redirect IPs 104.26.10.152, 104.26.11.152, 172.67.73.72, 2606:4700:20::681a:a98, 2606:4700:20::681a:b98, 2606:4700:20::ac43:4948
Response IP 104.26.10.152
Found Yes
Hash f9f6f187f03848c624d8750e1d332334cb2b9f0ff95764a98370effdeba23392
SimHash a11d5c140193

Groups

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.freestuff.com.au/sitemap.xml