colabpantry.com.au
robots.txt

Robots Exclusion Standard data for colabpantry.com.au

Resource Scan

Scan Details

Site Domain colabpantry.com.au
Base Domain colabpantry.com.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-11T15:11:13+00:00
Next Scan 2025-02-09T15:11:13+00:00

Last Successful Scan

Scanned2023-06-26T11:55:59+00:00
URL https://colabpantry.com.au/robots.txt
Redirect https://www.colab.com.au/robots.txt
Redirect Domain www.colab.com.au
Redirect Base colab.com.au
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.22, 76.76.21.98
Response IP 76.76.21.98
Found Yes
Hash 74d2ea297dea1a0c0b1d358d15eeea252c558de7aba163cd004b65d613a70311
SimHash 6f4494d686b0

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.colab.com.au/sitemap.xml

Comments

  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.