digitalnationaus.com.au
robots.txt

Robots Exclusion Standard data for digitalnationaus.com.au

Resource Scan

Scan Details

Site Domain digitalnationaus.com.au
Base Domain digitalnationaus.com.au
Scan Status Ok
Last Scan2024-09-20T20:04:44+00:00
Next Scan 2024-09-27T20:04:44+00:00

Last Scan

Scanned2024-09-20T20:04:44+00:00
URL https://digitalnationaus.com.au/robots.txt
Domain IPs 203.176.102.69
Response IP 203.176.102.69
Found Yes
Hash 6dc19a4afe7da00510ff2d911f45f5e00546ffc28659f96264bb681ac2bc95fa
SimHash 081cd045ad11

Groups

*

Rule Path
Disallow /members/
Disallow /feedback/
Disallow /search/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.digitalnationaus.com.au/sitemap.xml
sitemap https://www.digitalnationaus.com.au/sitemap_news.xml

Comments

  • Global
  • Teads
  • User-agent: grapeshot
  • Disallow:
  • Sitemaps