Log In Sign Up

smartcompany.com.au
robots.txt

Robots Exclusion Standard data for smartcompany.com.au

Resource Scan

Scan Details

Site Domain smartcompany.com.au
Base Domain smartcompany.com.au
Scan Status Ok
Last Scan2024-06-11T20:43:45+00:00
Next Scan 2024-06-18T20:43:45+00:00

Last Scan

Scanned2024-06-11T20:43:45+00:00
URL https://smartcompany.com.au/robots.txt
Redirect https://www.smartcompany.com.au/robots.txt
Redirect Domain www.smartcompany.com.au
Redirect Base smartcompany.com.au
Domain IPs 192.0.66.219, 2a04:fa87:fffd::c000:42ec
Redirect IPs 3.165.82.15, 3.165.82.39, 3.165.82.42, 3.165.82.50
Response IP 3.165.82.42
Found Yes
Hash 21e832c005bbb3c563673076d6e1bd08d1a5a791b2de6d143caa8e72cb8f1b26
SimHash 483c5840c013

Groups

*

Rule Path
Disallow /wp-admin/

ia_archiver

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.smartcompany.com.au/sitemap_index.xml
sitemap https://www.inc-aus.com/sitemap_index.xml
Back to top

Comments

  • ---------------------------
  • ---------------------------
  • Block ChatGPT
  • ---------------------------
  • Block CommonCrawl
  • ---------------------------
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top