Log In Sign Up

precisiongroup.com.au
robots.txt

Robots Exclusion Standard data for precisiongroup.com.au

Resource Scan

Scan Details

Site Domain precisiongroup.com.au
Base Domain precisiongroup.com.au
Scan Status Ok
Last Scan2025-11-14T23:48:05+00:00
Next Scan 2025-12-14T23:48:05+00:00

Last Scan

Scanned2025-11-14T23:48:05+00:00
URL https://precisiongroup.com.au/robots.txt
Redirect https://precisionrtoresources.com.au/robots.txt
Redirect Domain precisionrtoresources.com.au
Redirect Base precisionrtoresources.com.au
Domain IPs 104.21.6.166, 172.67.135.9, 2606:4700:3031::6815:6a6, 2606:4700:3031::ac43:8709
Redirect IPs 104.26.14.218, 104.26.15.218, 172.67.73.31, 2606:4700:20::681a:eda, 2606:4700:20::681a:fda, 2606:4700:20::ac43:491f
Response IP 172.67.73.31
Found Yes
Hash d728f72296c90a73bbf1692ca449e4873481e2118b81700e8865a4e3ce0cf51c
SimHash 3132db506e16

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/*
Disallow /*add-to-cart%3D*
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /shop/*
Disallow /simulated-business-sites/bounce-fitness/wp-content/uploads/*
Disallow /simulated-business-sites/bouncev1/wp-content/uploads/*
Disallow /simulated-business-sites/thecontinenthotel/wp-content/uploads/*
Allow /wp-admin/admin-ajax.php

googlebot-image

Rule Path
Allow /wp-content/uploads/2021/09/cropped-Precision-RTO-Resources-Favicon-32x32.jpg
Allow /wp-content/uploads/2021/09/cropped-Precision-RTO-Resources-Favicon-192x192.jpg
Allow /wp-content/uploads/2021/09/cropped-Precision-RTO-Resources-Favicon-180x180.jpg

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefssiteaudit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

google-extended

Rule Path
Allow /

gptbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

ccbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

metabot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://precisionrtoresources.com.au/sitemap_index.xml
Back to top

Comments

  • robots.txt for precisionrtoresources.com.au
  • Last updated: 2025-09-11
  • -----------------------
  • General Crawler Rules
  • -----------------------
  • -----------------------
  • Image Crawlers
  • -----------------------
  • -----------------------
  • SEO Audit Tools
  • -----------------------
  • -----------------------
  • AI and LLM Crawlers Access Policy
  • -----------------------
  • Allow Google Gemini (via Google-Extended)
  • Allow OpenAI's GPTBot
  • Allow Anthropic’s ClaudeBot
  • Allow Common Crawl (used by many LLMs)
  • Allow Perplexity AI's crawler
  • Allow Amazon’s AI crawler
  • Allow Meta's AI training crawler
  • -----------------------
  • XML Sitemap
  • -----------------------
Back to top